Sep 02 12:38:52 devstack cinder-volume[76276]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 12:38:52 devstack cinder-volume[76276]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 12:38:52 devstack cinder-volume[76276]: we strongly recommend against using it for new projects. Sep 02 12:38:52 devstack cinder-volume[76276]: If you are already using Eventlet, we recommend migrating to a different Sep 02 12:38:52 devstack cinder-volume[76276]: framework. For more detail see Sep 02 12:38:52 devstack cinder-volume[76276]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 12:38:52 devstack cinder-volume[76276]: import eventlet # noqa Sep 02 12:38:55 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:38:55 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:38:55 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:38:56 devstack cinder-volume[76276]: INFO dbcounter [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Registered counter for database cinder Sep 02 12:38:56 devstack cinder-volume[76276]: DEBUG oslo_db.sqlalchemy.engines [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:38:56 devstack cinder-volume[76276]: DEBUG dbcounter [-] [76276] Writer thread running {{(pid=76276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:38:56 devstack cinder-volume[76276]: INFO cinder.rpc [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 12:38:56 devstack cinder-volume[76276]: INFO cinder.rpc [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 12:38:56 devstack cinder-volume[76276]: DEBUG oslo_db.sqlalchemy.engines [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:38:56 devstack cinder-volume[76276]: INFO cinder.volume.manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Determined volume DB was empty at startup. Sep 02 12:38:56 devstack cinder-volume[76276]: DEBUG cinder.volume.manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76276) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 12:38:56 devstack cinder-volume[76276]: INFO cinder.volume.manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 12:38:56 devstack cinder-volume[76276]: WARNING stevedore.named [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 12:38:56 devstack cinder-volume[76276]: WARNING castellan.key_manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:38:56 devstack cinder-volume[76276]: WARNING cinder.keymgr.conf_key_mgr [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG cinder.volume.drivers.lvm [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76276) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_concurrency.processutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_concurrency.processutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.517s {{(pid=76276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_db.sqlalchemy.engines [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:38:57 devstack cinder-volume[76276]: INFO cinder.rpc [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 02 12:38:57 devstack cinder-volume[76276]: INFO cinder.rpc [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 02 12:38:57 devstack cinder-volume[76276]: WARNING stevedore.named [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 12:38:57 devstack cinder-volume[76276]: WARNING castellan.key_manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:38:57 devstack cinder-volume[76276]: INFO cinder.volume.manager [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_db.sqlalchemy.engines [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:38:57 devstack cinder-volume[76276]: INFO oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Starting 1 workers Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Started child 76436 {{(pid=76276) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Full set of CONF: {{(pid=76276) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] ******************************************************************************** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Configuration options gathered from: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] ================================================================================ {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] allow_availability_zone_fallback = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] allow_compression_on_image_upload = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] allowed_direct_url_schemes = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] api_rate_limit = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] auth_strategy = keystone {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] az_cache_duration = 3600 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_availability_zone = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_host = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_stats_polling_interval = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backup_api_class = cinder.backup.api.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backup_name_template = backup-%s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backup_use_same_host = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backup_use_temp_snapshot = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] chap_password = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] chap_username = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_internal_tenant_project_id = 1a04ba8cc4cf4d359fc4f8b537b37b65 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_internal_tenant_user_id = 4409bd222e0a476dbd5046445f2ad8c7 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cloned_volume_same_az = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cluster = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] compression_format = gzip {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] compute_api_class = cinder.compute.nova.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] config_dir = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] config_source = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] control_exchange = openstack {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] debug = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] default_availability_zone = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] default_group_type = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] default_volume_type = lvmdriver-1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] disk_geometry = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_client_cert = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_client_cert_key = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_data_namespace = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_ssl_cert_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_ssl_cert_verify = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] driver_use_ssl = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] enable_force_upload = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] enable_new_services = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] enable_unsupported_driver = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] enforce_multipath_for_image_xfer = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] filter_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_api_insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_api_ssl_compression = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_ca_certificates_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_catalog_info = image:glance:publicURL {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_num_retries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance_request_timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] goodness_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] graceful_shutdown_timeout = 5 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] group_api_class = cinder.group.api.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] host = devstack {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_compress_on_upload = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_conversion_address_space_limit = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_conversion_cpu_limit = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_conversion_disable = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_upload_use_cinder_backend = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_upload_use_internal_tenant = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_volume_cache_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_volume_cache_max_count = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] init_host_max_objects_retrieval = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] instance_format = [instance: %(uuid)s] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iscsi_target_flags = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iscsi_write_cache = on {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iser_helper = tgtadm {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iser_ip_address = 192.168.122.82 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iser_port = 3260 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_color = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: INFO cinder.volume.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_config_append = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_dir = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_options = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_rotate_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_rotate_interval_type = days {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] log_rotation_type = none {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] max_age = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] max_logfile_count = 30 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] max_logfile_size_mb = 200 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] max_over_subscription_ratio = 20.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] message_reap_interval = 86400 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] message_ttl = 2592000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] monkey_patch = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] monkey_patch_modules = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] my_ip = 192.168.122.82 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] no_snapshot_gb_quota = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] num_iser_scan_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] num_shell_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] num_volume_device_scan_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] nvmeof_conn_info_version = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] nvmet_ns_id = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] nvmet_port_id = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_max_limit = 1000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_ext_list = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_listen_port = 8776 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_use_ssl = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] osapi_volume_workers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] per_volume_size_limit = -1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] periodic_fuzzy_delay = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] periodic_interval = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] public_endpoint = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] publish_errors = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_backup_gigabytes = 1000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_backups = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_gigabytes = 1000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_groups = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_snapshots = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] quota_volumes = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] rate_limit_burst = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] rate_limit_except_level = CRITICAL {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] rate_limit_interval = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] reinit_driver_count = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] replication_device = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] report_discard_supported = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] report_interval = 120 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] reservation_clean_interval = 86400 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] reservation_expire = 86400 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] reserved_image_namespaces = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] reserved_percentage = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] rpc_response_timeout = 120 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] run_external_periodic_tasks = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] scst_target_driver = iscsi {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] scst_target_iqn_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_down_time = 720 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] shell_completion = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] snapshot_name_template = snapshot-%s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] snapshot_same_host = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] split_loggers = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] state_path = /opt/stack/data/cinder {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] storage_availability_zone = nova {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] storage_protocol = iSCSI {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] syslog_log_facility = LOG_USER {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_helper = lioadm {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_ip_address = 192.168.122.82 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_port = 3260 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_protocol = iscsi {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] target_secondary_ip_addresses = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] trace_flags = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] transport_url = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] until_refresh = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_chap_auth = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_default_quota_class = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_journal = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_json = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_multipath_for_image_xfer = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_stderr = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] use_syslog = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] verify_glance_signatures = enabled {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_api_class = cinder.volume.api.API {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_backend_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_clear = zero {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_clear_ionice = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_clear_size = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_copy_bps_limit = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_dd_blocksize = 1M {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_name_template = volume-%s {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_service_inithost_offload = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volume_usage_audit_period = month {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] zoning_mode = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.auth_section = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.auth_type = password {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.auth_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.cache = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.interface = public {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_password = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack sudo[76506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcache_username = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.region_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.service_type = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack sudo[76506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.backend = dogpile.cache.null {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.backend_argument = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.backend_expiration_time = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.config_prefix = cache.oslo {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.debug_cache_backend = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.enable_retry_client = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.enable_socket_keepalive = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.expiration_time = 600 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_dead_retry = 300 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_pool_maxsize = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_sasl_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.password = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.proxies = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.redis_db = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.redis_server = localhost:6379 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.retry_attempts = 2 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.retry_delay = 0.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.socket_keepalive_count = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.socket_keepalive_idle = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.socket_keepalive_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.socket_timeout = 1.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.tls_allowed_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.tls_cafile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.tls_certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.tls_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.tls_keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cache.username = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] coordination.backend_url = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.asyncio_connection = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.asyncio_slave_connection = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.backend = sqlalchemy {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.connection = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.connection_debug = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.connection_parameters = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.connection_recycle_time = 3600 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.connection_trace = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.db_inc_retry_interval = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.db_max_retries = 20 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.db_max_retry_interval = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.db_retry_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.max_overflow = 50 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.max_pool_size = 5 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.max_retries = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.pool_timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.retry_interval = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.slave_connection = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.sqlite_synchronous = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.synchronous_reader = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] database.use_db_reconnect = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_tracing.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.connection_string = messaging:// {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.es_doc_type = notification {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.es_scroll_size = 10000 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.es_scroll_time = 2m {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.filter_error_trace = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.hmac_keys = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.sentinel_service_name = mymaster {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.socket_timeout = 0.1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.trace_requests = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler.trace_sqlalchemy = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler_jaeger.process_tags = {} {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] profiler_otlp.service_name_prefix = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.policy_default_rule = default {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.policy_file = policy.yaml {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.group = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.helper_command = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] privsep_osbrick.user = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.group = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.helper_command = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] cinder_sys_admin.user = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.auth_section = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.auth_type = password {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.cafile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.collect_timing = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.send_service_user_token = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.split_loggers = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.tls_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] service_user.tls_min_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.auth_section = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.auth_type = password {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.collect_timing = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.region_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.split_loggers = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.tls_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] glance.tls_min_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.backend_availability_zone = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.chap_password = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.chap_username = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.disk_geometry = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_client_cert = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_data_namespace = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.driver_use_ssl = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.extra_capabilities = {} {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.filter_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.goodness_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iscsi_target_flags = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iser_helper = tgtadm {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iser_port = 3260 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.lvm_share_target = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.lvm_type = auto {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.replication_device = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.report_discard_supported = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_helper = tgtadm {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_port = 3260 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_protocol = iscsi {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.trace_flags = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.use_chap_auth = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_backend_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_clear = zero {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_reports.file_event_handler = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_reports.log_dir = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.backend_host = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.chap_password = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.chap_username = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.disk_geometry = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.filter_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.goodness_function = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iser_helper = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iser_ip_address = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iser_port = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.lvm_share_target = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.lvm_type = auto {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.num_shell_tries = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.replication_device = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.storage_protocol = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_helper = lioadm {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_ip_address = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_port = 3260 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.trace_flags = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.use_chap_auth = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:57 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_clear = zero {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_clear_size = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] lvmdriver-1.volumes_dir = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_notifications.driver = [] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] key_manager.fixed_key = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.barbican_api_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.barbican_endpoint = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.barbican_endpoint_type = public {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.barbican_region_name = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.cafile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.collect_timing = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.number_of_retries = 60 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.retry_delay = 1 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.send_service_user_token = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.split_loggers = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.tls_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.tls_min_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.verify_ssl = True {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican.verify_ssl_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.auth_section = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.auth_type = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.cafile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.certfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.collect_timing = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.insecure = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.keyfile = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.split_loggers = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.timeout = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.tls_ciphers = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] barbican_service_user.tls_min_version = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.approle_role_id = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.approle_secret_id = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.auth_method = approle {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.auth_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.kv_mountpoint = secret {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.kv_path = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.kv_version = 2 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.namespace = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.root_token_id = **** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.ssl_ca_crt_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.timeout = 60.0 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.token_file = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.token_role = None {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.use_ssl = False {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:38:58 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] ******************************************************************************** {{(pid=76276) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 12:38:58 devstack sudo[76506]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:58 devstack sudo[76603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:38:58 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:58 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:38:58 devstack cinder-volume[76436]: INFO cinder.brick.local_dev.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:58 devstack sudo[76688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:38:58 devstack sudo[76688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:58 devstack sudo[76688]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG cinder.brick.local_dev.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76436) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 02 12:38:58 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:58 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:38:58 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:59 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.527s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:59 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:38:59 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:59 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:38:59 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 02 12:38:59 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:38:59 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.357s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:38:59 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:00 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:39:00 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:00 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:00 devstack sudo[77125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:39:00 devstack sudo[77125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:00 devstack sudo[77125]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:00 devstack sudo[77175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:00 devstack sudo[77175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:00 devstack sudo[77175]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:00 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:00 devstack sudo[77217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:00 devstack sudo[77217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:01 devstack sudo[77217]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:01 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:01 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: INFO cinder.volume.drivers.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack sudo[77231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:01 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:01 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack sudo[77234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:39:01 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:01 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:01 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:01 devstack sudo[77237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:01 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:02 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:02 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:02 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:02 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:02 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:02 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:02 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:02 devstack cinder-volume[76436]: INFO cinder.volume.driver [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Driver hasn't implemented _init_vendor_properties() Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG cinder.volume.driver [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76436) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_db.sqlalchemy.engines [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writer thread running {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG cinder.db.api [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Building query based on filter {{(pid=76436) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG cinder.image.image_utils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76436) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 12:39:02 devstack cinder-volume[76436]: INFO cinder.keymgr.migration [None req-dae4385a-6bf1-4d38-ba71-7d7531784e28 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:39:02 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:02 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:39:02 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:03 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:03 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:03 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:03 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:03 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:03 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:03 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:03 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:03 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:03 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:03 devstack cinder-volume[76436]: DEBUG cinder.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Notifying Schedulers of capabilities ... {{(pid=76436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:39:04 devstack cinder-volume[76436]: INFO cinder.volume.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Driver initialization completed successfully. Sep 02 12:39:04 devstack cinder-volume[76436]: INFO cinder.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Initiating service 2 cleanup Sep 02 12:39:04 devstack cinder-volume[76436]: INFO cinder.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Service 2 cleanup completed. Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG cinder.service [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Creating RPC server for service cinder-volume {{(pid=76436) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG cinder.service [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76436) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 12:39:04 devstack cinder-volume[76436]: INFO cinder.volume.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:04 devstack sudo[77263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:39:04 devstack sudo[77263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:04 devstack sudo[77263]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:04 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:04 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:04 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:04 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:39:04 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:04 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:04 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:39:04 devstack sudo[77275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:39:04 devstack sudo[77275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:39:05 devstack sudo[77275]: pam_unix(sudo:session): session closed for user root Sep 02 12:39:05 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:39:05 devstack cinder-volume[76436]: INFO cinder.volume.manager [None req-616bf116-a37d-4bdc-bbd7-0ac85b446c7f None None] Driver post RPC initialization completed successfully. Sep 02 12:39:07 devstack cinder-volume[76276]: DEBUG dbcounter [-] [76276] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:39:14 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writing DB stats cinder:SELECT=3 {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:39:15 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:39:18 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager._thread_info {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:39:18 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread count: 6 {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:39:18 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread info: [<_MainThread(MainThread, started 125481465413760)>, , , , , ] {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:40:18 devstack sudo[79665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:40:18 devstack sudo[79665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:40:18 devstack sudo[79665]: pam_unix(sudo:session): session closed for user root Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:40:18 devstack sudo[79684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:40:18 devstack sudo[79684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:40:18 devstack sudo[79684]: pam_unix(sudo:session): session closed for user root Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:40:18 devstack sudo[79687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:40:18 devstack sudo[79687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:40:18 devstack sudo[79687]: pam_unix(sudo:session): session closed for user root Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:40:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:40:18 devstack sudo[79690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:40:18 devstack sudo[79690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:40:19 devstack sudo[79690]: pam_unix(sudo:session): session closed for user root Sep 02 12:40:19 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:40:19 devstack cinder-volume[76436]: DEBUG cinder.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Notifying Schedulers of capabilities ... {{(pid=76436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:40:19 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager._thread_info {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:40:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread count: 6 {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:40:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread info: [<_MainThread(MainThread, started 125481465413760)>, , , , , ] {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:41:15 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writing DB stats cinder:SELECT=1 {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:41:15 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writing DB stats cinder:UPDATE=1 {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:41:18 devstack sudo[82889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:41:18 devstack sudo[82889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:41:18 devstack sudo[82889]: pam_unix(sudo:session): session closed for user root Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:41:18 devstack sudo[82892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:41:18 devstack sudo[82892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:41:18 devstack sudo[82892]: pam_unix(sudo:session): session closed for user root Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:41:18 devstack sudo[82895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:41:18 devstack sudo[82895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:41:18 devstack sudo[82895]: pam_unix(sudo:session): session closed for user root Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:41:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:41:18 devstack sudo[82899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:41:18 devstack sudo[82899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:41:19 devstack sudo[82899]: pam_unix(sudo:session): session closed for user root Sep 02 12:41:19 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:41:19 devstack cinder-volume[76436]: DEBUG cinder.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Notifying Schedulers of capabilities ... {{(pid=76436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:42:18 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:42:18 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:42:18 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:42:18 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:42:18 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:42:18 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:42:18 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:42:18 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:42:18 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Sep 02 12:42:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:42:19 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:42:19 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:42:19 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG cinder.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Notifying Schedulers of capabilities ... {{(pid=76436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager._thread_info {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread count: 6 {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:42:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread info: [<_MainThread(MainThread, started 125481465413760)>, , , , , ] {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:43:15 devstack cinder-volume[76436]: DEBUG dbcounter [-] [76436] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG cinder.volume.drivers.lvm [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Updating volume stats {{(pid=76436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:18 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 12:43:18 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:18 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:18 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:43:18 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:18 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:18 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 12:43:18 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:18 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:18 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:18 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 12:43:18 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:19 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:19 devstack cinder-volume[76436]: DEBUG oslo_concurrency.processutils [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:19 devstack cinder-volume[76436]: DEBUG cinder.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Notifying Schedulers of capabilities ... {{(pid=76436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:43:19 devstack cinder-volume[76436]: DEBUG oslo_service.periodic_task [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] Running periodic task VolumeManager._thread_info {{(pid=76436) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:43:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread count: 6 {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:43:19 devstack cinder-volume[76436]: DEBUG cinder.volume.manager [None req-9c722b44-94a6-482a-bc27-b82280e73793 None None] thread info: [<_MainThread(MainThread, started 125481465413760)>, , , , , ] {{(pid=76436) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:43:23 devstack cinder-volume[76276]: INFO oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Caught SIGTERM, stopping children Sep 02 12:43:23 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Acquiring lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:23 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Acquired lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:23 devstack cinder-volume[76276]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Releasing lock "singleton_lock" {{(pid=76276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:23 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Stop services. {{(pid=76276) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 12:43:23 devstack cinder-volume[76276]: DEBUG oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Killing children. {{(pid=76276) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 12:43:23 devstack cinder-volume[76276]: INFO oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Waiting on 1 children to exit Sep 02 12:43:24 devstack cinder-volume[76436]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Acquiring lock "singleton_lock" {{(pid=76436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:24 devstack cinder-volume[76436]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Acquired lock "singleton_lock" {{(pid=76436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:24 devstack cinder-volume[76436]: DEBUG oslo_concurrency.lockutils [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Releasing lock "singleton_lock" {{(pid=76436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:24 devstack cinder-volume[76436]: WARNING amqp [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 12:43:24 devstack cinder-volume[76436]: WARNING amqp [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 12:43:24 devstack cinder-volume[76276]: INFO oslo_service.backend._eventlet.service [None req-2e162033-e110-4bec-8a52-9b2dd428e4f1 None None] Child 76436 exited with status 0 Sep 02 12:43:24 devstack cinder-volume[86444]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 12:43:24 devstack cinder-volume[86444]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 12:43:24 devstack cinder-volume[86444]: we strongly recommend against using it for new projects. Sep 02 12:43:24 devstack cinder-volume[86444]: If you are already using Eventlet, we recommend migrating to a different Sep 02 12:43:24 devstack cinder-volume[86444]: framework. For more detail see Sep 02 12:43:24 devstack cinder-volume[86444]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 12:43:24 devstack cinder-volume[86444]: import eventlet # noqa Sep 02 12:43:26 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:26 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:26 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:27 devstack cinder-volume[86444]: INFO dbcounter [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Registered counter for database cinder Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_db.sqlalchemy.engines [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG dbcounter [-] [86444] Writer thread running {{(pid=86444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:43:27 devstack cinder-volume[86444]: INFO cinder.rpc [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 12:43:27 devstack cinder-volume[86444]: INFO cinder.rpc [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_db.sqlalchemy.engines [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:27 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Determined volume DB was empty at startup. Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG cinder.volume.manager [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86444) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 12:43:27 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 12:43:27 devstack cinder-volume[86444]: WARNING stevedore.named [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 12:43:27 devstack cinder-volume[86444]: WARNING castellan.key_manager [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:43:27 devstack cinder-volume[86444]: WARNING cinder.keymgr.conf_key_mgr [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:43:27 devstack cinder-volume[86444]: INFO cinder.volume.manager [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_db.sqlalchemy.engines [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:27 devstack cinder-volume[86444]: INFO oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Starting 1 workers Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Started child 86659 {{(pid=86444) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Full set of CONF: {{(pid=86444) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] ******************************************************************************** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Configuration options gathered from: {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 12:43:27 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] ================================================================================ {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] allow_availability_zone_fallback = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] allow_compression_on_image_upload = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] allowed_direct_url_schemes = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] api_rate_limit = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] auth_strategy = keystone {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_availability_zone = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86659]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_host = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_stats_polling_interval = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backup_api_class = cinder.backup.api.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backup_name_template = backup-%s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backup_use_same_host = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backup_use_temp_snapshot = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] chap_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] chap_username = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_internal_tenant_project_id = 1a04ba8cc4cf4d359fc4f8b537b37b65 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_internal_tenant_user_id = 4409bd222e0a476dbd5046445f2ad8c7 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cluster = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] compression_format = gzip {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] compute_api_class = cinder.compute.nova.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] config_dir = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] config_source = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] control_exchange = openstack {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] debug = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] default_availability_zone = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] default_group_type = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] default_volume_type = QuobyteHD {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] disk_geometry = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_client_cert = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_client_cert_key = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_data_namespace = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_ssl_cert_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_ssl_cert_verify = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] driver_use_ssl = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] enable_new_services = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] enable_unsupported_driver = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] enabled_backends = ['QuobyteHD'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] enforce_multipath_for_image_xfer = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] filter_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_api_insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_api_ssl_compression = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_ca_certificates_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_catalog_info = image:glance:publicURL {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_num_retries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance_request_timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] goodness_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] graceful_shutdown_timeout = 5 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] group_api_class = cinder.group.api.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] host = devstack {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_compress_on_upload = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_conversion_address_space_limit = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_conversion_cpu_limit = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_conversion_disable = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_upload_use_cinder_backend = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_upload_use_internal_tenant = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_volume_cache_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_volume_cache_max_count = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] image_volume_cache_max_size_gb = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] init_host_max_objects_retrieval = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] instance_format = [instance: %(uuid)s] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iscsi_target_flags = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iscsi_write_cache = on {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iser_helper = tgtadm {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iser_ip_address = 192.168.122.82 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iser_port = 3260 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_color = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_config_append = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_dir = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_options = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_rotate_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_rotate_interval_type = days {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] log_rotation_type = none {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] max_age = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] max_logfile_count = 30 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] max_logfile_size_mb = 200 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] max_over_subscription_ratio = 20.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] message_reap_interval = 86400 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] message_ttl = 2592000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] migration_create_volume_timeout_secs = 300 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] monkey_patch = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] monkey_patch_modules = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] my_ip = 192.168.122.82 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] no_snapshot_gb_quota = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] num_iser_scan_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86659) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] num_shell_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] num_volume_device_scan_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] nvmeof_conn_info_version = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] nvmet_ns_id = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] nvmet_port_id = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_max_limit = 1000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_ext_list = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_listen_port = 8776 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_use_ssl = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] osapi_volume_workers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] per_volume_size_limit = -1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] periodic_fuzzy_delay = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] periodic_interval = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] public_endpoint = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] publish_errors = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_backup_gigabytes = 1000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_backups = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_gigabytes = 1000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_groups = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_snapshots = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] quota_volumes = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] rate_limit_burst = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] rate_limit_except_level = CRITICAL {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] rate_limit_interval = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] reinit_driver_count = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] replication_device = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] report_discard_supported = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] report_interval = 120 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] reservation_clean_interval = 86400 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] reservation_expire = 86400 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] reserved_image_namespaces = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] reserved_percentage = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] rpc_response_timeout = 120 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] run_external_periodic_tasks = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] scst_target_driver = iscsi {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] scst_target_iqn_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_down_time = 720 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] shell_completion = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] snapshot_name_template = snapshot-%s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] split_loggers = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] state_path = /opt/stack/data/cinder {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] storage_availability_zone = nova {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] storage_protocol = iSCSI {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] syslog_log_facility = LOG_USER {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_helper = lioadm {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_ip_address = 192.168.122.82 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_port = 3260 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_protocol = iscsi {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] target_secondary_ip_addresses = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] trace_flags = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] transport_url = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] until_refresh = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_chap_auth = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_default_quota_class = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_journal = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_json = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_multipath_for_image_xfer = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_stderr = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] use_syslog = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] verify_glance_signatures = enabled {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_api_class = cinder.volume.api.API {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_backend_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_clear = zero {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_clear_ionice = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_clear_size = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_copy_bps_limit = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_dd_blocksize = 1M {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_name_template = volume-%s {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_service_inithost_offload = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volume_usage_audit_period = month {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] zoning_mode = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_concurrency.disable_process_locking = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.auth_section = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.auth_type = password {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.auth_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.cache = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.include_service_catalog = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.interface = public {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcache_username = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.region_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.service_type = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.backend = dogpile.cache.null {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.backend_argument = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.backend_expiration_time = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.config_prefix = cache.oslo {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.debug_cache_backend = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.enable_retry_client = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.enable_socket_keepalive = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.expiration_time = 600 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.hashclient_retry_attempts = 2 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_dead_retry = 300 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_pool_maxsize = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_sasl_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.proxies = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.redis_db = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.redis_server = localhost:6379 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.retry_attempts = 2 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.retry_delay = 0.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.socket_keepalive_count = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.socket_keepalive_idle = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.socket_keepalive_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.socket_timeout = 1.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.tls_allowed_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.tls_cafile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.tls_certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.tls_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.tls_keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cache.username = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] coordination.backend_url = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.asyncio_connection = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.asyncio_slave_connection = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.backend = sqlalchemy {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.connection = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.connection_debug = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.connection_parameters = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.connection_recycle_time = 3600 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.connection_trace = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.db_inc_retry_interval = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.db_max_retries = 20 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.db_max_retry_interval = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.db_retry_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.max_overflow = 50 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.max_pool_size = 5 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.max_retries = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.mysql_wsrep_sync_wait = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.pool_timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.retry_interval = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.slave_connection = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.sqlite_synchronous = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.synchronous_reader = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] database.use_db_reconnect = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_tracing.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.connection_string = messaging:// {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.es_doc_type = notification {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.es_scroll_size = 10000 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.es_scroll_time = 2m {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.filter_error_trace = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.hmac_keys = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.sentinel_service_name = mymaster {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.socket_timeout = 0.1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.trace_requests = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler.trace_sqlalchemy = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler_jaeger.process_tags = {} {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler_jaeger.service_name_prefix = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] profiler_otlp.service_name_prefix = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.enforce_new_defaults = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.policy_default_rule = default {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.policy_file = policy.yaml {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.group = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.helper_command = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] privsep_osbrick.user = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.group = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.helper_command = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] cinder_sys_admin.user = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.auth_section = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.auth_type = password {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.cafile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.collect_timing = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.send_service_user_token = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.split_loggers = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.tls_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] service_user.tls_min_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.auth_section = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.auth_type = password {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.collect_timing = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.region_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.split_loggers = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.tls_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] glance.tls_min_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.backend_availability_zone = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.chap_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.chap_username = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.disk_geometry = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_client_cert = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86659) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_client_cert_key = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_data_namespace = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.driver_use_ssl = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.extra_capabilities = {} {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.filter_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.goodness_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iscsi_target_flags = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iscsi_write_cache = on {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iser_helper = tgtadm {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iser_port = 3260 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Running cmd (subprocess): mount.quobyte {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_host = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_login = admin {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_mount_options = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_private_key = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_share_path = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.num_shell_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.quobyte_volume_url = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.replication_device = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.report_discard_supported = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.reserved_percentage = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_helper = tgtadm {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_port = 3260 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_protocol = iscsi {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.trace_flags = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.unique_fqdn_network = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.use_chap_auth = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_backend_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_clear = zero {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_clear_ionice = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_clear_size = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_reports.file_event_handler = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_reports.log_dir = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.backend_availability_zone = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.backend_host = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.chap_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.chap_username = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.chiscsi_conf = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.disk_geometry = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_client_cert = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_data_namespace = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.driver_use_ssl = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.extra_capabilities = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.filter_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.goodness_function = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iser_helper = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iser_ip_address = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iser_port = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.iser_target_prefix = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_host = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_login = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_mount_options = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_password = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_private_key = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_share_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_ssh_port = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.num_shell_tries = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.nvmet_port_id = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.replication_device = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.report_discard_supported = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.reserved_percentage = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.scst_target_driver = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.storage_protocol = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_helper = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_ip_address = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_port = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_prefix = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_protocol = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.trace_flags = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.use_chap_auth = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_clear = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_clear_size = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] QuobyteHD.volumes_dir = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_notifications.driver = [] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_notifications.retry = -1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] key_manager.fixed_key = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.barbican_api_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.barbican_endpoint = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.barbican_endpoint_type = public {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.barbican_region_name = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.cafile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.collect_timing = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.number_of_retries = 60 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.retry_delay = 1 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.send_service_user_token = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.split_loggers = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.tls_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.tls_min_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.verify_ssl = True {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican.verify_ssl_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.auth_section = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.auth_type = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.cafile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.certfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.collect_timing = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.insecure = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.keyfile = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.split_loggers = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.timeout = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.tls_ciphers = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] barbican_service_user.tls_min_version = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.approle_role_id = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.approle_secret_id = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.auth_method = approle {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.auth_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.kv_mountpoint = secret {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.kv_path = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.kv_version = 2 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.namespace = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.root_token_id = **** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.ssl_ca_crt_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.timeout = 60.0 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.token_file = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.token_role = None {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.use_ssl = False {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:28 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] ******************************************************************************** {{(pid=86444) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 12:43:28 devstack quobyte-client[86664]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 12:43:28 devstack quobyte-client[86664]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:28 devstack cinder-volume[86659]: INFO cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 ... Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 -c /etc/quobyte/client-cinder.cfg {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:28 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 -c /etc/quobyte/client-cinder.cfg Sep 02 12:43:28 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:28 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.413s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:28 devstack cinder-volume[86659]: INFO cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 succeeded Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.424s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:28 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:28 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:29 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.259s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.volume.driver [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Driver hasn't implemented _init_vendor_properties() Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.volume.driver [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.881504058838, 'free_capacity_gb': 1773.881504058838, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_db.sqlalchemy.engines [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writer thread running {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.db.api [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Building query based on filter {{(pid=86659) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86659) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.keymgr.migration [None req-db2ab327-26e8-40d3-b443-6a2c0f11eaf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:29 devstack sudo[86737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:29 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:29 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.230s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Driver initialization completed successfully. Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Initiating service 3 cleanup Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Service 3 cleanup completed. Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.service [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Creating RPC server for service cinder-volume {{(pid=86659) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.service [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86659) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:29 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:29 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:29 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.252s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c981e3f3-d907-43d4-98bf-c6292bc2d56d None None] Driver post RPC initialization completed successfully. Sep 02 12:43:33 devstack cinder-volume[86444]: INFO oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Caught SIGTERM, stopping children Sep 02 12:43:33 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Acquiring lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:33 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Acquired lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:33 devstack cinder-volume[86444]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Releasing lock "singleton_lock" {{(pid=86444) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:33 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Stop services. {{(pid=86444) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 12:43:33 devstack cinder-volume[86444]: DEBUG oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Killing children. {{(pid=86444) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 12:43:33 devstack cinder-volume[86444]: INFO oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Waiting on 1 children to exit Sep 02 12:43:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Acquiring lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Acquired lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Releasing lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:33 devstack cinder-volume[86659]: WARNING amqp [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 12:43:33 devstack cinder-volume[86659]: WARNING amqp [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 12:43:33 devstack cinder-volume[86444]: INFO oslo_service.backend._eventlet.service [None req-4bf45ff9-5da6-44d5-9327-4b96c9d3b84f None None] Child 86659 exited with status 0 Sep 02 12:43:34 devstack cinder-volume[86931]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 12:43:34 devstack cinder-volume[86931]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 12:43:34 devstack cinder-volume[86931]: we strongly recommend against using it for new projects. Sep 02 12:43:34 devstack cinder-volume[86931]: If you are already using Eventlet, we recommend migrating to a different Sep 02 12:43:34 devstack cinder-volume[86931]: framework. For more detail see Sep 02 12:43:34 devstack cinder-volume[86931]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 12:43:34 devstack cinder-volume[86931]: import eventlet # noqa Sep 02 12:43:36 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 12:43:36 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 12:43:36 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 12:43:37 devstack cinder-volume[86931]: INFO dbcounter [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Registered counter for database cinder Sep 02 12:43:37 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG dbcounter [-] [86931] Writer thread running {{(pid=86931) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:43:38 devstack cinder-volume[86931]: INFO cinder.rpc [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 12:43:38 devstack cinder-volume[86931]: INFO cinder.rpc [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:38 devstack cinder-volume[86931]: INFO cinder.volume.manager [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Determined volume DB was empty at startup. Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG cinder.volume.manager [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86931) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 12:43:38 devstack cinder-volume[86931]: WARNING stevedore.named [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 12:43:38 devstack cinder-volume[86931]: WARNING castellan.key_manager [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:43:38 devstack cinder-volume[86931]: WARNING cinder.keymgr.conf_key_mgr [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 12:43:38 devstack cinder-volume[86931]: INFO cinder.volume.manager [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:38 devstack cinder-volume[86931]: INFO oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Starting 1 workers Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Started child 87092 {{(pid=86931) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Full set of CONF: {{(pid=86931) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] Configuration options gathered from: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] ================================================================================ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 12:43:38 devstack cinder-volume[87092]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] allow_availability_zone_fallback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] allow_compression_on_image_upload = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] allowed_direct_url_schemes = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] api_rate_limit = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] auth_strategy = keystone {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_stats_polling_interval = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backup_api_class = cinder.backup.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backup_name_template = backup-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backup_use_same_host = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backup_use_temp_snapshot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] chap_username = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_internal_tenant_project_id = 1a04ba8cc4cf4d359fc4f8b537b37b65 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_internal_tenant_user_id = 4409bd222e0a476dbd5046445f2ad8c7 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cluster = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] compression_format = gzip {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] config_dir = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] config_source = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] control_exchange = openstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] debug = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] default_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] default_group_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] default_volume_type = QuobyteHD {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_ssl_cert_verify = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] driver_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] enable_new_services = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] enable_unsupported_driver = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] enforce_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_api_insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_api_ssl_compression = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_ca_certificates_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_num_retries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance_request_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 12:43:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87092) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] graceful_shutdown_timeout = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] group_api_class = cinder.group.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] host = devstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_compress_on_upload = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_conversion_address_space_limit = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_conversion_cpu_limit = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_conversion_disable = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_upload_use_cinder_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_upload_use_internal_tenant = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_volume_cache_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_volume_cache_max_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] init_host_max_objects_retrieval = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] instance_format = [instance: %(uuid)s] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iscsi_target_flags = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iscsi_write_cache = on {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iser_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iser_ip_address = 192.168.122.82 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iser_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_color = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_config_append = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_options = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_rotate_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_rotate_interval_type = days {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] log_rotation_type = none {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] max_age = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] max_logfile_count = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] max_logfile_size_mb = 200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] max_over_subscription_ratio = 20.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] message_reap_interval = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] message_ttl = 2592000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] monkey_patch = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] monkey_patch_modules = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] my_ip = 192.168.122.82 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] no_snapshot_gb_quota = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] num_iser_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] num_shell_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] num_volume_device_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] nvmeof_conn_info_version = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] nvmet_ns_id = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] nvmet_port_id = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_max_limit = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_ext_list = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_listen_port = 8776 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] osapi_volume_workers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] per_volume_size_limit = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] periodic_fuzzy_delay = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] periodic_interval = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] public_endpoint = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] publish_errors = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_backup_gigabytes = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_backups = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_gigabytes = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_groups = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_snapshots = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] quota_volumes = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] rate_limit_burst = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] rate_limit_except_level = CRITICAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] rate_limit_interval = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] reinit_driver_count = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] report_discard_supported = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] report_interval = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] reservation_clean_interval = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] reservation_expire = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] reserved_image_namespaces = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] reserved_percentage = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] rpc_response_timeout = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] run_external_periodic_tasks = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] scst_target_driver = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_down_time = 720 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] shell_completion = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] snapshot_name_template = snapshot-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] state_path = /opt/stack/data/cinder {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] storage_availability_zone = nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] storage_protocol = iSCSI {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] syslog_log_facility = LOG_USER {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_helper = lioadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_ip_address = 192.168.122.82 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_protocol = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] target_secondary_ip_addresses = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] transport_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] until_refresh = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_chap_auth = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_default_quota_class = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_journal = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_json = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_stderr = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] use_syslog = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] verify_glance_signatures = enabled {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_api_class = cinder.volume.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_clear = zero {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_clear_size = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_copy_bps_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_dd_blocksize = 1M {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_name_template = volume-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_service_inithost_offload = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volume_usage_audit_period = month {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] zoning_mode = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.auth_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87092) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 12:43:38 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 12:43:38 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Running cmd (subprocess): mount.quobyte {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.interface = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:38 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcache_username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.service_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.backend = dogpile.cache.null {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.backend_argument = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.backend_expiration_time = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.config_prefix = cache.oslo {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.debug_cache_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.enable_retry_client = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.enable_socket_keepalive = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.expiration_time = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_dead_retry = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_sasl_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.proxies = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.redis_db = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.redis_server = localhost:6379 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.retry_attempts = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.retry_delay = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.socket_keepalive_count = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.socket_keepalive_idle = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.socket_keepalive_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.socket_timeout = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.tls_allowed_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.tls_cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.tls_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.tls_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.tls_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cache.username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] coordination.backend_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.asyncio_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.asyncio_slave_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.backend = sqlalchemy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.connection_debug = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.connection_parameters = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.connection_recycle_time = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.connection_trace = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.db_inc_retry_interval = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.db_max_retries = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.db_max_retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.db_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.max_overflow = 50 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.max_pool_size = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.max_retries = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.pool_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.slave_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.sqlite_synchronous = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.synchronous_reader = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] database.use_db_reconnect = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack quobyte-client[87110]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 12:43:39 devstack quobyte-client[87110]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_tracing.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.connection_string = messaging:// {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.es_doc_type = notification {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.es_scroll_size = 10000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.es_scroll_time = 2m {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.filter_error_trace = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.hmac_keys = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.sentinel_service_name = mymaster {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.socket_timeout = 0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.trace_requests = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler.trace_sqlalchemy = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler_jaeger.process_tags = {} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] profiler_otlp.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.policy_default_rule = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.group = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] privsep_osbrick.user = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.group = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] cinder_sys_admin.user = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.send_service_user_token = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] service_user.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] glance.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:39 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.chap_username = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.driver_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.extra_capabilities = {} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iscsi_target_flags = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iser_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_host = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_login = admin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_mount_options = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_private_key = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_share_path = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.report_discard_supported = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_protocol = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.use_chap_auth = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_clear = zero {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_reports.file_event_handler = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_reports.log_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.backend_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.chap_username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.extra_capabilities = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iser_helper = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iser_ip_address = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iser_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_login = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_mount_options = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_private_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_share_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.num_shell_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.report_discard_supported = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.reserved_percentage = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.scst_target_driver = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.storage_protocol = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_helper = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_ip_address = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_protocol = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.use_chap_auth = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_clear = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_clear_size = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] QuobyteHD.volumes_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_notifications.driver = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] key_manager.fixed_key = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.barbican_api_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.barbican_endpoint = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.barbican_endpoint_type = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.barbican_region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.number_of_retries = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.retry_delay = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.send_service_user_token = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.verify_ssl = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican.verify_ssl_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.auth_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] barbican_service_user.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.approle_role_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.approle_secret_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.auth_method = approle {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.auth_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.kv_mountpoint = secret {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.kv_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.kv_version = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.root_token_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.ssl_ca_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.token_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.token_role = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 12:43:39 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-dc6df50b-5c68-4e66-88ca-3acd8ac9b5b2 None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 12:43:39 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:39 devstack cinder-volume[87092]: INFO cinder.volume.driver [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Driver hasn't implemented _init_vendor_properties() Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.volume.driver [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.881504058838, 'free_capacity_gb': 1773.881504058838, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_db.sqlalchemy.engines [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writer thread running {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.db.api [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Building query based on filter {{(pid=87092) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87092) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:39 devstack cinder-volume[87092]: INFO cinder.keymgr.migration [None req-23b0861e-b363-48fd-8868-77dbb8be9adc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 12:43:39 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:39 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:39 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:39 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:43:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Driver initialization completed successfully. Sep 02 12:43:39 devstack cinder-volume[87092]: INFO cinder.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Initiating service 3 cleanup Sep 02 12:43:40 devstack cinder-volume[87092]: INFO cinder.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Service 3 cleanup completed. Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG cinder.service [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Creating RPC server for service cinder-volume {{(pid=87092) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG cinder.service [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87092) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 12:43:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:43:40 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:43:40 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:43:40 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Sep 02 12:43:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:43:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ed19b11-8b59-4340-b532-6c2cb6e0ea2f None None] Driver post RPC initialization completed successfully. Sep 02 12:43:48 devstack cinder-volume[86931]: DEBUG dbcounter [-] [86931] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86931) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:43:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:43:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:44:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:44:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 6 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:44:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:44:40 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Flow 'volume_create_manager' (d862cc1c-69aa-40f3-a49d-23ba66d72788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b1e50-a94d-43a5-a028-8a915c4ca896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b1e50-a94d-43a5-a028-8a915c4ca896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2073697036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ffcb2e-95c1-44e5-aed4-100501f074d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab7d47fd1894d0db5893d66623e630d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:44:41Z,use_quota=True,user_id='89f5573177df430b81c5b34abf52346a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5b305d-1172-4a92-b71d-0c9e1b2865dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5b305d-1172-4a92-b71d-0c9e1b2865dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75e15ac-d8ec-46eb-bfee-7ffeaad05c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75e15ac-d8ec-46eb-bfee-7ffeaad05c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ffcb2e-95c1-44e5-aed4-100501f074d9', 'volume_name': 'volume-07ffcb2e-95c1-44e5-aed4-100501f074d9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1a87d-325b-4c71-8135-88622bc222ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1a87d-325b-4c71-8135-88622bc222ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a058ce0-af62-46f5-9078-1a1ea6721b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Volume 07ffcb2e-95c1-44e5-aed4-100501f074d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ffcb2e-95c1-44e5-aed4-100501f074d9', 'volume_size': 1} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2073697036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ffcb2e-95c1-44e5-aed4-100501f074d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ab7d47fd1894d0db5893d66623e630d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:44:41Z,use_quota=True,user_id='89f5573177df430b81c5b34abf52346a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Creating volume 07ffcb2e-95c1-44e5-aed4-100501f074d9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:44:41 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:44:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:44:41 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 1073741824 Sep 02 12:44:41 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:44:42 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 1073741824" returned: 0 in 0.896s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:44:42 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 Sep 02 12:44:42 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:44:42 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a058ce0-af62-46f5-9078-1a1ea6721b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ffcb2e-95c1-44e5-aed4-100501f074d9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3f51e8-3aef-46f9-9dcd-91faea3c1545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:44:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Volume volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 (07ffcb2e-95c1-44e5-aed4-100501f074d9): created successfully Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3f51e8-3aef-46f9-9dcd-91faea3c1545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:44:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Flow 'volume_create_manager' (d862cc1c-69aa-40f3-a49d-23ba66d72788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:44:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-138febad-cb39-431d-b414-3ee06d228943 tempest-TaggedAttachmentsTest-1785833616 None] Created volume successfully. Sep 02 12:44:52 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:44:52 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Flow 'volume_create_manager' (ce0593cb-a307-474b-a7ee-2a9d80f9699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be22a2-a434-40f4-8bed-67a52fe8ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be22a2-a434-40f4-8bed-67a52fe8ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1758472686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169c73b010f485d81e3f62818b3af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:45:02Z,use_quota=True,user_id='af826382dcaa4c489d7dd92995997b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb396db-3930-49f2-9b66-32b9e535b3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb396db-3930-49f2-9b66-32b9e535b3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef9c488-cad5-4689-8649-f1f433f659fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef9c488-cad5-4689-8649-f1f433f659fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e', 'volume_name': 'volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee9eec-e349-4823-a36b-0ce2015571bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee9eec-e349-4823-a36b-0ce2015571bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc0782-4d39-47c8-9f1c-2c455bdcf929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Volume 0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e', 'volume_size': 1} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1758472686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169c73b010f485d81e3f62818b3af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:45:02Z,use_quota=True,user_id='af826382dcaa4c489d7dd92995997b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Creating volume 0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:45:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:45:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:02 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e 1073741824 Sep 02 12:45:02 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:03 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e 1073741824" returned: 0 in 1.184s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:03 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e Sep 02 12:45:03 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:04 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" returned: 0 in 0.631s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc0782-4d39-47c8-9f1c-2c455bdcf929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2b3413-8922-49ac-bd9c-8efe8c6b1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Volume volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e (0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e): created successfully Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2b3413-8922-49ac-bd9c-8efe8c6b1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Flow 'volume_create_manager' (ce0593cb-a307-474b-a7ee-2a9d80f9699f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:45:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4985e057-b355-4831-906f-d3044d613448 tempest-DeleteServersTestJSON-1261587672 None] Created volume successfully. Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Flow 'volume_create_manager' (5fd5555f-bc67-4609-b37f-8fc9f893b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42ba151-072b-4bcd-8710-1ad740e12d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42ba151-072b-4bcd-8710-1ad740e12d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1559546327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9199bd-702b-4d5c-8456-a2fbff8e22df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0b732c4acb449f96cf1e16fd4f7c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:45:11Z,use_quota=True,user_id='77b073bc20924c48a791a78de92e6720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c39979-7e2b-4ab6-8a44-d27d22372505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c39979-7e2b-4ab6-8a44-d27d22372505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70a96a2-ad66-4804-882d-af9767cd0e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70a96a2-ad66-4804-882d-af9767cd0e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9199bd-702b-4d5c-8456-a2fbff8e22df', 'volume_name': 'volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8dbc07-0322-4126-9076-929e90dde361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8dbc07-0322-4126-9076-929e90dde361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805a63dd-4f9a-4a34-a972-8b8d5ac8ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Volume ff9199bd-702b-4d5c-8456-a2fbff8e22df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df', 'volume_size': 1} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1559546327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9199bd-702b-4d5c-8456-a2fbff8e22df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0b732c4acb449f96cf1e16fd4f7c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:45:11Z,use_quota=True,user_id='77b073bc20924c48a791a78de92e6720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Creating volume ff9199bd-702b-4d5c-8456-a2fbff8e22df {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:45:11 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:45:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:11 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df 1073741824 Sep 02 12:45:11 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:12 devstack cinder-volume[87092]: WARNING py.warnings [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 02 12:45:12 devstack cinder-volume[87092]: .first() Sep 02 12:45:12 devstack cinder-volume[87092]: Sep 02 12:45:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:12 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df 1073741824" returned: 0 in 1.013s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:12 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df Sep 02 12:45:12 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:13 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.319s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805a63dd-4f9a-4a34-a972-8b8d5ac8ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eac845d-379a-4bce-be46-dd0c79a44f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.212s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Volume volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df (ff9199bd-702b-4d5c-8456-a2fbff8e22df): created successfully Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eac845d-379a-4bce-be46-dd0c79a44f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Flow 'volume_create_manager' (5fd5555f-bc67-4609-b37f-8fc9f893b764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:45:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22686711-9ef7-40d2-8fd0-9105b90d11a8 tempest-VolumesAdminNegativeTest-150876733 None] Created volume successfully. Sep 02 12:45:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b051e697-ebb6-4d62-9e10-085a9fcb74fc', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:45:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-d6320de9-5536-4994-ae8e-27a85b48a54c req-1246d80f-7b7e-482b-9daf-3b804cb5ed01 tempest-DeleteServersTestJSON-1261587672 None] attachment_update completed successfully. Sep 02 12:45:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Acquiring lock "cinder-ff9199bd-702b-4d5c-8456-a2fbff8e22df-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:45:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "cinder-ff9199bd-702b-4d5c-8456-a2fbff8e22df-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:45:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Acquiring lock "cinder-quobyte-ff9199bd-702b-4d5c-8456-a2fbff8e22df" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:45:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "cinder-quobyte-ff9199bd-702b-4d5c-8456-a2fbff8e22df" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:45:15 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu5muo9pf/privsep.sock'] Sep 02 12:45:15 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu5muo9pf/privsep.sock Sep 02 12:45:15 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 12:45:16 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 02 12:45:17 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:17 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Spawned new privsep daemon via rootwrap Sep 02 12:45:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Accepted privsep connection to /tmp/tmpu5muo9pf/privsep.sock {{(pid=87092) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 02 12:45:17 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 02 12:45:17 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 02 12:45:17 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 02 12:45:17 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88815 Sep 02 12:45:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a96c97-5f59-4dfd-89ba-a68302887015]: (2,) {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:45:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb914dc-6dd4-415d-bc11-4d235f7cbefe]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:45:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:17 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df Sep 02 12:45:17 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:18 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df" returned: 0 in 0.982s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:18 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df Sep 02 12:45:18 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:19 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ff9199bd-702b-4d5c-8456-a2fbff8e22df" returned: 0 in 1.038s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "cinder-quobyte-ff9199bd-702b-4d5c-8456-a2fbff8e22df" released by "delete_volume" :: held 4.028s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:45:19 devstack cinder-volume[87092]: WARNING cinder.quota [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:45:19 devstack cinder-volume[87092]: WARNING cinder.quota [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Created reservations ['ea09c4ee-88c3-47e3-bfa7-0d1e9ad2f5de', 'fc34658f-d155-4b2b-bc91-0a6761892556', '41021a97-73fa-4065-871e-4296b5464d9c', '2e4c918b-ac82-4ad4-90df-3d77841c9aa6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:19 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:45:19 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:20 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.674s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:45:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Deleted volume successfully. Sep 02 12:45:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5fef06a-37fa-424d-b08e-b020d4d7a730 tempest-VolumesAdminNegativeTest-150876733 None] Lock "cinder-ff9199bd-702b-4d5c-8456-a2fbff8e22df-delete_volume" released by "delete_volume" :: held 5.292s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:45:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-29d4bb1f-1004-43d7-ba33-86c1fbd1e87e req-2e8ee498-a476-4d0c-9c5f-7de76060dc08 tempest-DeleteServersTestJSON-1261587672 None] Terminate volume connection completed successfully. Sep 02 12:45:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-29d4bb1f-1004-43d7-ba33-86c1fbd1e87e req-2e8ee498-a476-4d0c-9c5f-7de76060dc08 tempest-DeleteServersTestJSON-1261587672 None] Deleting attachment b051e697-ebb6-4d62-9e10-085a9fcb74fc. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "cinder-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "cinder-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "cinder-quobyte-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "cinder-quobyte-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b40d5-1732-4a26-ac58-838ced369218]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:45:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:23 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e Sep 02 12:45:23 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:24 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" returned: 0 in 0.554s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:24 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e Sep 02 12:45:24 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:24 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" returned: 0 in 0.397s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "cinder-quobyte-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e" released by "delete_volume" :: held 1.011s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Created reservations ['9349192e-747a-4984-8d77-85a31e1d075e', '5c1cebe6-e5b1-490e-b4af-1bdbd9a1f978', '1dee94c1-288a-465c-81a4-1851fc347362', '6f13267d-3d2b-45ca-ba37-b886ded7e04c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:25 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:45:25 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:25 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:45:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Deleted volume successfully. Sep 02 12:45:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-94f705e3-34e8-4f8c-be28-5a91746e9dac tempest-DeleteServersTestJSON-1261587672 None] Lock "cinder-0bf42a0e-6514-4ba8-ad23-8b1f88ab7e4e-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:45:34 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=26,cinder:SELECT=19,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:45:35 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:45:37 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:45:37 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:45:37 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 8 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:45:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:45:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:45:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:45:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-41b77d29-7cee-42ec-b2f7-cec2e05ab2f9 req-7584dc19-1d8d-410f-b9c7-3cbc8f887878 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:45:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-41b77d29-7cee-42ec-b2f7-cec2e05ab2f9 req-7584dc19-1d8d-410f-b9c7-3cbc8f887878 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:45:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-41b77d29-7cee-42ec-b2f7-cec2e05ab2f9 req-7584dc19-1d8d-410f-b9c7-3cbc8f887878 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:45:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-41b77d29-7cee-42ec-b2f7-cec2e05ab2f9 req-7584dc19-1d8d-410f-b9c7-3cbc8f887878 tempest-TaggedAttachmentsTest-1785833616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-07ffcb2e-95c1-44e5-aed4-100501f074d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e3bf8c0-e513-4b3d-aa0e-22a5248d2091', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:45:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-41b77d29-7cee-42ec-b2f7-cec2e05ab2f9 req-7584dc19-1d8d-410f-b9c7-3cbc8f887878 tempest-TaggedAttachmentsTest-1785833616 None] attachment_update completed successfully. Sep 02 12:46:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-5bf5010a-3c41-4e14-bdd3-a3a536c58cbc req-91acccde-3ed8-4469-b46b-8ce045870370 tempest-TaggedAttachmentsTest-1785833616 None] Terminate volume connection completed successfully. Sep 02 12:46:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-5bf5010a-3c41-4e14-bdd3-a3a536c58cbc req-91acccde-3ed8-4469-b46b-8ce045870370 tempest-TaggedAttachmentsTest-1785833616 None] Deleting attachment 4e3bf8c0-e513-4b3d-aa0e-22a5248d2091. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:46:08 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=8 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:46:15 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Flow 'volume_create_manager' (e2b12463-6197-4f06-be8c-a2cbf0555818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b3ac3-b228-457a-b153-7a3391ede095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b3ac3-b228-457a-b153-7a3391ede095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1415983138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc4545b-6a42-4863-a7c6-f1d3c71f09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75bdf3f038546329b62372cfb52a5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:46:27Z,use_quota=True,user_id='585231380b2848148948b5f6fe1df2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e186c18-0356-483a-82a3-f032a68aef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e186c18-0356-483a-82a3-f032a68aef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a36098-baa3-4a83-b908-5a30eb68c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a36098-baa3-4a83-b908-5a30eb68c275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc4545b-6a42-4863-a7c6-f1d3c71f09b0', 'volume_name': 'volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a584084-aef3-469b-9569-55f4794acae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a584084-aef3-469b-9569-55f4794acae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8edd6f-b947-4cd0-b5af-c8d05e337920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Volume 9cc4545b-6a42-4863-a7c6-f1d3c71f09b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0', 'volume_size': 1} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1415983138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc4545b-6a42-4863-a7c6-f1d3c71f09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75bdf3f038546329b62372cfb52a5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:46:27Z,use_quota=True,user_id='585231380b2848148948b5f6fe1df2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Creating volume 9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:46:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:46:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:27 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 1073741824 Sep 02 12:46:27 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:28 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 1073741824" returned: 0 in 1.142s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:28 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 Sep 02 12:46:28 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "cinder-07ffcb2e-95c1-44e5-aed4-100501f074d9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "cinder-07ffcb2e-95c1-44e5-aed4-100501f074d9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "cinder-quobyte-07ffcb2e-95c1-44e5-aed4-100501f074d9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "cinder-quobyte-07ffcb2e-95c1-44e5-aed4-100501f074d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e31c2c-1578-4f89-8acc-c742adc57441]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:46:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:29 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8edd6f-b947-4cd0-b5af-c8d05e337920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13180d12-41b7-4f46-8a23-9db617c30ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Volume volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 (9cc4545b-6a42-4863-a7c6-f1d3c71f09b0): created successfully Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13180d12-41b7-4f46-8a23-9db617c30ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Flow 'volume_create_manager' (e2b12463-6197-4f06-be8c-a2cbf0555818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:46:29 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 Sep 02 12:46:29 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8cbf96da-f207-4e20-ad3d-528cb5df5bc7 tempest-ServerRescueNegativeTestJSON-1473404299 None] Created volume successfully. Sep 02 12:46:29 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:29 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9 Sep 02 12:46:29 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:29 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-07ffcb2e-95c1-44e5-aed4-100501f074d9" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "cinder-quobyte-07ffcb2e-95c1-44e5-aed4-100501f074d9" released by "delete_volume" :: held 0.989s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Created reservations ['ab9db875-2d10-4301-b4ae-f43b0624000c', '403d8c48-aa3b-448b-a4b3-9e61e9157484', 'f8842af9-9ea6-41a2-8028-77744e677cde', '02b8f993-3d37-48ac-a521-cab87b5e2d03'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:30 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:46:30 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:30 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:46:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Deleted volume successfully. Sep 02 12:46:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1fc007a9-97d5-4d7e-be39-3f94c0aa5138 tempest-TaggedAttachmentsTest-1785833616 None] Lock "cinder-07ffcb2e-95c1-44e5-aed4-100501f074d9-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:37 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:46:37 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:37 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (bda68d94-37ed-46ef-b100-e5c612d9be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80fc610-7caa-4d89-95c1-56015d5a66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80fc610-7caa-4d89-95c1-56015d5a66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1804219248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bf1138-5d50-41f9-96f1-8bc0a8436e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:46:39Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e76929-1b00-4fe2-8e84-287259037bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e76929-1b00-4fe2-8e84-287259037bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969825a0-a206-429b-8249-f1429388547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969825a0-a206-429b-8249-f1429388547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bf1138-5d50-41f9-96f1-8bc0a8436e69', 'volume_name': 'volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4c3ac7-6434-4f65-883e-4fbe90ab4780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4c3ac7-6434-4f65-883e-4fbe90ab4780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e59895-0a4c-4f18-9892-9256fa325378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Volume 12bf1138-5d50-41f9-96f1-8bc0a8436e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69', 'volume_size': 1} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1804219248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bf1138-5d50-41f9-96f1-8bc0a8436e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:46:39Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Creating volume 12bf1138-5d50-41f9-96f1-8bc0a8436e69 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:46:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:46:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:39 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 1073741824 Sep 02 12:46:39 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:40 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 1073741824" returned: 0 in 1.109s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:40 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 Sep 02 12:46:40 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:41 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e59895-0a4c-4f18-9892-9256fa325378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0076e05-8036-4b5b-b89f-88dd3fedffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:46:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Volume volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 (12bf1138-5d50-41f9-96f1-8bc0a8436e69): created successfully Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0076e05-8036-4b5b-b89f-88dd3fedffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:46:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (bda68d94-37ed-46ef-b100-e5c612d9be43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:46:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-49e633ef-e9b2-410a-834e-551adedefe99 tempest-AttachVolumeTestJSON-1797836842 None] Created volume successfully. Sep 02 12:46:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9ebb426d-e88a-4ac0-a01c-b19da7d2305a req-6019dc3d-ceaa-4c3d-96d8-4fdb733a5fc1 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9ebb426d-e88a-4ac0-a01c-b19da7d2305a req-6019dc3d-ceaa-4c3d-96d8-4fdb733a5fc1 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9ebb426d-e88a-4ac0-a01c-b19da7d2305a req-6019dc3d-ceaa-4c3d-96d8-4fdb733a5fc1 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9ebb426d-e88a-4ac0-a01c-b19da7d2305a req-6019dc3d-ceaa-4c3d-96d8-4fdb733a5fc1 tempest-AttachVolumeTestJSON-1797836842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acfa445e-5efc-4d01-876f-dac0fdc6e722', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:46:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-9ebb426d-e88a-4ac0-a01c-b19da7d2305a req-6019dc3d-ceaa-4c3d-96d8-4fdb733a5fc1 tempest-AttachVolumeTestJSON-1797836842 None] attachment_update completed successfully. Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Acquiring lock "cinder-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "cinder-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Acquiring lock "cinder-quobyte-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "cinder-quobyte-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e2b48-e08f-43b1-8012-961f6ec2ee82]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:48 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 Sep 02 12:46:48 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:48 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" returned: 0 in 0.502s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:48 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0 Sep 02 12:46:48 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:49 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" returned: 0 in 0.715s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "cinder-quobyte-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0" released by "delete_volume" :: held 1.297s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Created reservations ['64b907c5-ca7e-4966-a5eb-176963cc6ce6', '2215a273-a9b7-475e-b66c-472a37220692', 'a62dd4c2-9e04-4ef4-83c0-5b1ae05f4871', '83be4cd0-41f0-4601-a562-1b06f0389660'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:46:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:46:49 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:46:49 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:46:50 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Sep 02 12:46:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:46:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:46:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Deleted volume successfully. Sep 02 12:46:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f84ddbe-f88d-41f6-8cac-90ae49621342 tempest-ServerRescueNegativeTestJSON-1473404299 None] Lock "cinder-9cc4545b-6a42-4863-a7c6-f1d3c71f09b0-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:46:59 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=31,cinder:SELECT=16,cinder:INSERT=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:47:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Flow 'volume_create_manager' (fb56ddb4-1452-41bb-a6e7-7ced6686cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a08df1e-071c-4e56-bb70-1a8473898b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a08df1e-071c-4e56-bb70-1a8473898b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1607050148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f96f05-bd41-4f59-881f-97a0ba2a1c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324b71018cc945bc97b1afcb68abd1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:05Z,use_quota=True,user_id='f4c07d7440034f21992bcae50c74f51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92551d5-441e-430c-b185-7b3dda38bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92551d5-441e-430c-b185-7b3dda38bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f305f8-b0d2-4e01-847c-f338a3d14949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f305f8-b0d2-4e01-847c-f338a3d14949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'volume_name': 'volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f4e8b-cdba-4f51-917d-ad13df8d3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f4e8b-cdba-4f51-917d-ad13df8d3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6c3138-ccc2-4a1e-8e0e-522c0f6cdf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Volume d9f96f05-bd41-4f59-881f-97a0ba2a1c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'volume_size': 1} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1607050148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f96f05-bd41-4f59-881f-97a0ba2a1c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324b71018cc945bc97b1afcb68abd1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:05Z,use_quota=True,user_id='f4c07d7440034f21992bcae50c74f51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Creating volume d9f96f05-bd41-4f59-881f-97a0ba2a1c35 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:47:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:47:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:05 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 1073741824 Sep 02 12:47:05 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:06 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 1073741824" returned: 0 in 0.676s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:06 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 Sep 02 12:47:06 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:06 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6c3138-ccc2-4a1e-8e0e-522c0f6cdf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ae6be7-5055-4b66-bc29-17aed708b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Volume volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 (d9f96f05-bd41-4f59-881f-97a0ba2a1c35): created successfully Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ae6be7-5055-4b66-bc29-17aed708b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Flow 'volume_create_manager' (fb56ddb4-1452-41bb-a6e7-7ced6686cb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c3999f3a-5c80-4b92-b992-fbedc75fb933 tempest-ServerActionsTestOtherA-1400848441 None] Created volume successfully. Sep 02 12:47:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ddcf05b-b129-4025-8894-3bd8c821318b tempest-BackendsCapabilitiesAdminTestsJSON-831034400 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.881504058838, 'free_capacity_gb': 1773.881504058838, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 12:47:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edd4f209-2b19-4dc4-ae5b-b889f0671f14 tempest-BackendsCapabilitiesAdminTestsJSON-831034400 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.881504058838, 'free_capacity_gb': 1773.881504058838, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 12:47:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b19675ad-2e91-4e8a-9bc7-b13fa066a744 tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-1511996562: creating Sep 02 12:47:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b19675ad-2e91-4e8a-9bc7-b13fa066a744 tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-1511996562: created successfully Sep 02 12:47:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b19675ad-2e91-4e8a-9bc7-b13fa066a744 tempest-GroupSnapshotsTest-950438097 None] Create group completed successfully. Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (61710180-a0e6-42e0-8d1f-c128095a174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca68c7c1-14cb-4fce-9d04-e6386a79be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca68c7c1-14cb-4fce-9d04-e6386a79be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970671798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2aed0ca-d56e-4c45-b04d-f7c22fe8ac58,host='devstack@QuobyteHD#QuobyteHD',id=d3a220c9-bfe9-42d5-bde9-e0881cc2169d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:18Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6653f99f-29be-41cf-a4cb-94815a5b5b70),volume_type_id=6653f99f-29be-41cf-a4cb-94815a5b5b70)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2aadc2-db61-4be9-82a7-61d735aac983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2aadc2-db61-4be9-82a7-61d735aac983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc28560-c34c-4917-885c-e2aa269987e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc28560-c34c-4917-885c-e2aa269987e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a220c9-bfe9-42d5-bde9-e0881cc2169d', 'volume_name': 'volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0b95fe-8736-4a1e-ab92-a2c69c8b38e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0b95fe-8736-4a1e-ab92-a2c69c8b38e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295ce85-1ec4-49a5-aa1c-b62e9497144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Volume d3a220c9-bfe9-42d5-bde9-e0881cc2169d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d', 'volume_size': 1} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2aed0ca-d56e-4c45-b04d-f7c22fe8ac58,created_at=2026-09-02T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970671798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2aed0ca-d56e-4c45-b04d-f7c22fe8ac58,host='devstack@QuobyteHD#QuobyteHD',id=d3a220c9-bfe9-42d5-bde9-e0881cc2169d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:18Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6653f99f-29be-41cf-a4cb-94815a5b5b70),volume_type_id=6653f99f-29be-41cf-a4cb-94815a5b5b70)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Creating volume d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:47:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:47:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:18 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d 1073741824 Sep 02 12:47:18 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:19 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d 1073741824" returned: 0 in 1.050s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:19 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:19 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:20 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 0.623s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295ce85-1ec4-49a5-aa1c-b62e9497144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab32189c-4eb8-42f6-840c-bdd7abaece66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Volume volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d (d3a220c9-bfe9-42d5-bde9-e0881cc2169d): created successfully Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab32189c-4eb8-42f6-840c-bdd7abaece66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (61710180-a0e6-42e0-8d1f-c128095a174f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8d6a80c1-404c-452f-b152-f38b41a099de tempest-GroupSnapshotsTest-950438097 None] Created volume successfully. Sep 02 12:47:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] GroupSnapshot 891c303f-9677-4026-af8b-9f97c4191759: creating. Sep 02 12:47:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-e353ebcb-bce6-4950-869a-86570f68163c req-fbf51118-8145-4e88-a677-23249741f8bb tempest-AttachVolumeTestJSON-1797836842 None] Terminate volume connection completed successfully. Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-e353ebcb-bce6-4950-869a-86570f68163c req-fbf51118-8145-4e88-a677-23249741f8bb tempest-AttachVolumeTestJSON-1797836842 None] Deleting attachment acfa445e-5efc-4d01-876f-dac0fdc6e722. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Group snapshot 891c303f-9677-4026-af8b-9f97c4191759: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Creating offline snapshot ac891477-6049-40b5-9507-0430928ded8c of volume d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7722f2c-91dc-42e2-8fa8-49edbcda7832]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:23 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:23 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:24 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 1.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:24 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c 1G Sep 02 12:47:24 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:25 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c 1G" returned: 0 in 1.074s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:25 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:25 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:25 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:47:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:25 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:25 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:26 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:26 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info Sep 02 12:47:26 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:26 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:26 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:47:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:26 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info Sep 02 12:47:26 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:27 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.info" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-180db3bf-95db-48d3-bd4b-da4cc0aa4ea4 tempest-GroupSnapshotsTest-950438097 None] group_snapshot 891c303f-9677-4026-af8b-9f97c4191759: created successfully Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c-8d0372e4-68fb-4851-9e50-b7fd56a18621" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c-8d0372e4-68fb-4851-9e50-b7fd56a18621" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Creating volume 8d0372e4-68fb-4851-9e50-b7fd56a18621 from snapshot ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] snapshot: ac891477-6049-40b5-9507-0430928ded8c, volume: 8d0372e4-68fb-4851-9e50-b7fd56a18621, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[834434dd-df20-452e-9bac-57137923308e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:31 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:31 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:31 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 1.139s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:47:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f671acb-6417-4c3c-8390-c948de13b29a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:32 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:32 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:33 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 1.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:47:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:47:33 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:47:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:33 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 Sep 02 12:47:33 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:37 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:47:37 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:38 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 1.062s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:47:38 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:47:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 8 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:47:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:47:40 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=9,cinder:INSERT=2,cinder:SELECT=11 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:47:43 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621" returned: 0 in 10.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:47:43 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Converted 1024.00 MB image at 99.26 MB/s Sep 02 12:47:43 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:47:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:43 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 Sep 02 12:47:43 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:44 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621" returned: 0 in 0.667s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" released by "_copy_volume_from_snapshot" :: held 13.985s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c-8d0372e4-68fb-4851-9e50-b7fd56a18621" released by "_create_volume_from_snapshot" :: held 14.149s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.178s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7c58fe7c-fb90-424c-94a6-1228a25768d3 tempest-GroupSnapshotsTest-950438097 None] Create group from source-snapshot-891c303f-9677-4026-af8b-9f97c4191759 completed successfully. Sep 02 12:47:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" acquired by "delete_volume" :: waited 0.044s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ce682-803e-4ed6-b213-ada4669ad5d3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:47 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 Sep 02 12:47:47 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fb8aacc2-5300-4542-9b81-d51f99571df8 req-51cf4d30-a067-4ab6-97b2-d661f87b6be6 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fb8aacc2-5300-4542-9b81-d51f99571df8 req-51cf4d30-a067-4ab6-97b2-d661f87b6be6 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:48 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fb8aacc2-5300-4542-9b81-d51f99571df8 req-51cf4d30-a067-4ab6-97b2-d661f87b6be6 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:48 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621 Sep 02 12:47:48 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-fb8aacc2-5300-4542-9b81-d51f99571df8 req-51cf4d30-a067-4ab6-97b2-d661f87b6be6 tempest-ServerActionsTestOtherA-1400848441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bad802b6-9937-4108-ab27-12f43646d96a', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:47:48 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8d0372e4-68fb-4851-9e50-b7fd56a18621" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-8d0372e4-68fb-4851-9e50-b7fd56a18621" released by "delete_volume" :: held 0.951s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-fb8aacc2-5300-4542-9b81-d51f99571df8 req-51cf4d30-a067-4ab6-97b2-d661f87b6be6 tempest-ServerActionsTestOtherA-1400848441 None] attachment_update completed successfully. Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['7b8f864a-30e4-4113-858a-975bf72aaf07'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:47:49 devstack cinder-volume[87092]: WARNING cinder.quota [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1152232790 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1152232790, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:47:49 devstack cinder-volume[87092]: WARNING cinder.quota [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1152232790 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1152232790, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['ffd39584-152b-47c9-aecb-13c6af188c92', '9005fcb9-fc15-485b-9c69-f06bb7f3b64f', '1c5e0b31-0301-45d7-879c-c9292d8003da', '280d8ed8-8038-4e29-91a4-9782a26474a7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:50 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:47:50 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:50 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:47:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-44fd5c93-24d6-4cf5-bfa4-1f077459f1e8 tempest-GroupSnapshotsTest-950438097 None] Delete group completed successfully. Sep 02 12:47:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] group_snapshot 891c303f-9677-4026-af8b-9f97c4191759: deleting Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] group_snapshot 891c303f-9677-4026-af8b-9f97c4191759: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Deleting offline snapshot ac891477-6049-40b5-9507-0430928ded8c of volume d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] snapshot_file for this snap is: volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06e8a87-fc7b-414a-b519-5c8c6b042389]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:50 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:50 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:51 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578e609-ab27-48ae-a69f-008d42f4e2d1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:51 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:51 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:51 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 0.529s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:51 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:51 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:51 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:51 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c Sep 02 12:47:51 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:52 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d.ac891477-6049-40b5-9507-0430928ded8c" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-ac891477-6049-40b5-9507-0430928ded8c" released by "_delete_snapshot" :: held 1.772s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" released by "delete_snapshot" :: held 1.798s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:52 devstack cinder-volume[87092]: WARNING cinder.quota [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1152232790 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1152232790, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:47:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] Created reservations ['11f02b34-173c-4dc8-9fdc-0908599d9206', 'bb9dbb3f-265c-4c83-9f47-9f66e006ca71', '6032f70e-37e9-4af6-aff0-a9d032639960', '4a5439d8-9979-4bdc-9536-b9754a0db49c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:47:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-191607e6-76a5-47d7-a69b-0d252b704dfb tempest-GroupSnapshotsTest-950438097 None] group_snapshot 891c303f-9677-4026-af8b-9f97c4191759: deleted successfully Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Flow 'volume_create_manager' (6eae03f3-959a-44a7-9d2b-6484b885f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da30f59-1643-4c8e-b922-e6e917168ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da30f59-1643-4c8e-b922-e6e917168ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316311195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026d1c36-1f87-463c-a152-41239ee2486f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca351594f734010bb00d5ba89972f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:54Z,use_quota=True,user_id='4b704b6d85234b29a7e1c4c3fa50709a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8526f-a72a-4fd1-abc9-27193aeb5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc8526f-a72a-4fd1-abc9-27193aeb5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f1f7ba-0045-46ec-aea8-4712369f4da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f1f7ba-0045-46ec-aea8-4712369f4da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026d1c36-1f87-463c-a152-41239ee2486f', 'volume_name': 'volume-026d1c36-1f87-463c-a152-41239ee2486f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b3637b-d541-4160-a8e4-eb93f33145c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b3637b-d541-4160-a8e4-eb93f33145c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8eb335-72d6-42f1-8575-35952727fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Volume 026d1c36-1f87-463c-a152-41239ee2486f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026d1c36-1f87-463c-a152-41239ee2486f', 'volume_size': 1} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316311195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026d1c36-1f87-463c-a152-41239ee2486f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca351594f734010bb00d5ba89972f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:54Z,use_quota=True,user_id='4b704b6d85234b29a7e1c4c3fa50709a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Creating volume 026d1c36-1f87-463c-a152-41239ee2486f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:47:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:54 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f 1073741824 Sep 02 12:47:54 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-1909d285-3d7b-4d3b-aac0-82f0f7a36f03 tempest-ServerActionsTestOtherA-1400848441 None] Terminate volume connection completed successfully. Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-1909d285-3d7b-4d3b-aac0-82f0f7a36f03 tempest-ServerActionsTestOtherA-1400848441 None] Deleting attachment bad802b6-9937-4108-ab27-12f43646d96a. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[84669ad9-7f82-4fda-9db6-539e3862d316]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:54 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:54 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:54 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f 1073741824" returned: 0 in 0.786s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:55 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 0.589s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:55 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f Sep 02 12:47:55 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:55 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d Sep 02 12:47:55 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-c839fbe2-c5e2-4b7f-9989-d3eea4c363d6 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:55 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-c839fbe2-c5e2-4b7f-9989-d3eea4c363d6 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.175s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8eb335-72d6-42f1-8575-35952727fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026d1c36-1f87-463c-a152-41239ee2486f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:55 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04241863-abf3-421e-b785-d65d058ab316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" returned: 0 in 0.312s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-c839fbe2-c5e2-4b7f-9989-d3eea4c363d6 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-d3a220c9-bfe9-42d5-bde9-e0881cc2169d" released by "delete_volume" :: held 1.069s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:47:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Volume volume-026d1c36-1f87-463c-a152-41239ee2486f (026d1c36-1f87-463c-a152-41239ee2486f): created successfully Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04241863-abf3-421e-b785-d65d058ab316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Flow 'volume_create_manager' (6eae03f3-959a-44a7-9d2b-6484b885f21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5e358c76-bf05-41f1-9cfa-dae5c903cfc2 tempest-ServersNegativeTestJSON-836565740 None] Created volume successfully. Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-c839fbe2-c5e2-4b7f-9989-d3eea4c363d6 tempest-ServerActionsTestOtherA-1400848441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f8e4211-a870-41a4-bbbf-3f120673a5b2', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:47:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-be7f1493-85a0-4681-9828-c050b7e8d766 req-c839fbe2-c5e2-4b7f-9989-d3eea4c363d6 tempest-ServerActionsTestOtherA-1400848441 None] attachment_update completed successfully. Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['72aff0cd-4307-49ff-aebe-df084e8efd73'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:47:55 devstack cinder-volume[87092]: WARNING cinder.db.api [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1152232790'] Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['d8127f68-4458-4198-9b4d-1999394c7c5a', 'fd206348-10a7-4240-8e9d-7a8c2e25ac4c', '22952884-97b8-4815-9c1a-3e4b99d3abb6', '167c3d64-d1b4-4378-b69e-a3e5d138fd47'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:55 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:47:55 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:56 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:47:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:47:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a1860f2f-d435-4c27-ad68-656d125935e0 tempest-GroupSnapshotsTest-950438097 None] Delete group completed successfully. Sep 02 12:47:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c43515d-d851-4b88-9f7a-2ee008e69332 tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-409035511: creating Sep 02 12:47:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c43515d-d851-4b88-9f7a-2ee008e69332 tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-409035511: created successfully Sep 02 12:47:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c43515d-d851-4b88-9f7a-2ee008e69332 tempest-GroupSnapshotsTest-950438097 None] Create group completed successfully. Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Flow 'volume_create_manager' (b774f4ae-425d-44a1-91f6-9d497c724f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f41b0bb-d36c-4f1e-b146-e5cc54f7c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f41b0bb-d36c-4f1e-b146-e5cc54f7c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-318579484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32b5096-d984-4eb4-ad2d-14f25d5f2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca351594f734010bb00d5ba89972f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:59Z,use_quota=True,user_id='4b704b6d85234b29a7e1c4c3fa50709a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb17aab-3454-4631-a456-a99ed1f9c632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb17aab-3454-4631-a456-a99ed1f9c632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299051f5-f822-4b2c-8690-e22c350c942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299051f5-f822-4b2c-8690-e22c350c942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32b5096-d984-4eb4-ad2d-14f25d5f2c91', 'volume_name': 'volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb02782-0097-4a3b-946a-c828122161df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb02782-0097-4a3b-946a-c828122161df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b49262-4d99-4ec1-9d6e-2cc80dbad2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Volume c32b5096-d984-4eb4-ad2d-14f25d5f2c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91', 'volume_size': 1} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-318579484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32b5096-d984-4eb4-ad2d-14f25d5f2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca351594f734010bb00d5ba89972f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:47:59Z,use_quota=True,user_id='4b704b6d85234b29a7e1c4c3fa50709a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Creating volume c32b5096-d984-4eb4-ad2d-14f25d5f2c91 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:47:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:47:59 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 1073741824 Sep 02 12:47:59 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=72,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (dbc27273-f48e-47ec-8430-4929c29e62eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22a9188-5d25-4f55-92a6-f4adac2a6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22a9188-5d25-4f55-92a6-f4adac2a6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1032297694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,host='devstack@QuobyteHD#QuobyteHD',id=c4023589-ef21-4d87-9fe7-ac95f99fd479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:00Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc6c44b-1aea-4744-b379-e641e4426a1f),volume_type_id=bfc6c44b-1aea-4744-b379-e641e4426a1f)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2720ab2b-3f97-4137-bc6d-e6f5db8bd9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2720ab2b-3f97-4137-bc6d-e6f5db8bd9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd790401-9f51-429c-a921-fe70794be207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd790401-9f51-429c-a921-fe70794be207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4023589-ef21-4d87-9fe7-ac95f99fd479', 'volume_name': 'volume-c4023589-ef21-4d87-9fe7-ac95f99fd479', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b13ad7-298b-4849-abcd-984232ddd4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b13ad7-298b-4849-abcd-984232ddd4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877e9095-e8b7-43f0-8a75-f7d3403f4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:47:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Volume c4023589-ef21-4d87-9fe7-ac95f99fd479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4023589-ef21-4d87-9fe7-ac95f99fd479', 'volume_size': 1} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:47:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 1073741824" returned: 0 in 0.750s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:00 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 Sep 02 12:48:00 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:00 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,created_at=2026-09-02T10:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1032297694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,host='devstack@QuobyteHD#QuobyteHD',id=c4023589-ef21-4d87-9fe7-ac95f99fd479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:00Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc6c44b-1aea-4744-b379-e641e4426a1f),volume_type_id=bfc6c44b-1aea-4744-b379-e641e4426a1f)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Creating volume c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:48:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b49262-4d99-4ec1-9d6e-2cc80dbad2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc05100e-a099-48ac-a9db-0d26d75f2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:00 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 1073741824 Sep 02 12:48:00 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Volume volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 (c32b5096-d984-4eb4-ad2d-14f25d5f2c91): created successfully Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc05100e-a099-48ac-a9db-0d26d75f2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Flow 'volume_create_manager' (b774f4ae-425d-44a1-91f6-9d497c724f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fc6e36b2-66ce-470e-9174-fe9bcf94c728 tempest-ServersNegativeTestJSON-836565740 None] Created volume successfully. Sep 02 12:48:00 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 1073741824" returned: 0 in 0.569s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:00 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 Sep 02 12:48:00 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:01 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877e9095-e8b7-43f0-8a75-f7d3403f4569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4023589-ef21-4d87-9fe7-ac95f99fd479', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a96e89c-49b0-49f0-867f-6e5f0672508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Volume volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 (c4023589-ef21-4d87-9fe7-ac95f99fd479): created successfully Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a96e89c-49b0-49f0-867f-6e5f0672508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (dbc27273-f48e-47ec-8430-4929c29e62eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-50ac144a-4986-4805-80f6-d0c32c2b5714 tempest-GroupSnapshotsTest-950438097 None] Created volume successfully. Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "cinder-c32b5096-d984-4eb4-ad2d-14f25d5f2c91-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-c32b5096-d984-4eb4-ad2d-14f25d5f2c91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "cinder-quobyte-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-quobyte-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[719040e4-51fe-44c5-a7b4-95f1c5220913]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:01 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 Sep 02 12:48:01 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:02 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:02 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91 Sep 02 12:48:02 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:02 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-quobyte-c32b5096-d984-4eb4-ad2d-14f25d5f2c91" released by "delete_volume" :: held 0.705s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Created reservations ['c3c47345-4e8b-44c4-83cb-f5c01783a295', 'c3b8b36d-8de3-4d67-b164-0105c37e8c76', '7fbb2a88-8d67-4045-bc7a-89d8477e3d20', '193f8958-7bef-4f29-b1d1-2c97e19bbd4c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:02 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:48:02 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:02 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:48:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Deleted volume successfully. Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b68f6f0-7d36-4c10-a305-b3cb1312bdcf tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-c32b5096-d984-4eb4-ad2d-14f25d5f2c91-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "cinder-026d1c36-1f87-463c-a152-41239ee2486f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-026d1c36-1f87-463c-a152-41239ee2486f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "cinder-quobyte-026d1c36-1f87-463c-a152-41239ee2486f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-quobyte-026d1c36-1f87-463c-a152-41239ee2486f" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[787237a1-faec-4b98-9b9c-8d53b8a1f35c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (a159cd4d-ee95-4e2f-b38d-e663c22f41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe8851f-ee25-40dd-beed-253d834a5b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe8851f-ee25-40dd-beed-253d834a5b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-613454418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,host='devstack@QuobyteHD#QuobyteHD',id=f92daa36-8356-4d32-9a19-64036110d0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:03Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc6c44b-1aea-4744-b379-e641e4426a1f),volume_type_id=bfc6c44b-1aea-4744-b379-e641e4426a1f)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a9bea0-ed33-4ffa-b106-4baffc4114c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a9bea0-ed33-4ffa-b106-4baffc4114c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdba5a2-34b6-49b8-a356-479216f04e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdba5a2-34b6-49b8-a356-479216f04e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92daa36-8356-4d32-9a19-64036110d0a5', 'volume_name': 'volume-f92daa36-8356-4d32-9a19-64036110d0a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56c00ee-b978-487c-800e-9a63c4805403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56c00ee-b978-487c-800e-9a63c4805403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf367123-61c2-46e8-9e09-0d164e509639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Volume f92daa36-8356-4d32-9a19-64036110d0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92daa36-8356-4d32-9a19-64036110d0a5', 'volume_size': 1} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,created_at=2026-09-02T10:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-613454418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c081aaa8-ccf4-40aa-9928-a3ebacb04044,host='devstack@QuobyteHD#QuobyteHD',id=f92daa36-8356-4d32-9a19-64036110d0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:03Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfc6c44b-1aea-4744-b379-e641e4426a1f),volume_type_id=bfc6c44b-1aea-4744-b379-e641e4426a1f)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Creating volume f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:03 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f Sep 02 12:48:03 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:48:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:03 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 1073741824 Sep 02 12:48:03 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:03 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:03 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f Sep 02 12:48:03 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:03 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 1073741824" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:03 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 Sep 02 12:48:03 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:03 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-026d1c36-1f87-463c-a152-41239ee2486f" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-quobyte-026d1c36-1f87-463c-a152-41239ee2486f" released by "delete_volume" :: held 0.776s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Created reservations ['7aac9a9c-7441-44c1-99a1-65ad3da81d99', 'bce3be4f-134b-47f5-8492-07b088cf3ea4', '85772e2c-df51-4fd1-a03e-0a160394553e', 'b840404c-142c-4cc7-87e7-1427a9f1709a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:03 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf367123-61c2-46e8-9e09-0d164e509639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92daa36-8356-4d32-9a19-64036110d0a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:48:03 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd66674e-c296-429c-9fc0-f9235d67403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Volume volume-f92daa36-8356-4d32-9a19-64036110d0a5 (f92daa36-8356-4d32-9a19-64036110d0a5): created successfully Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd66674e-c296-429c-9fc0-f9235d67403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (a159cd4d-ee95-4e2f-b38d-e663c22f41af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6fa28fa1-8d39-40bd-a708-9f1470725c88 tempest-GroupSnapshotsTest-950438097 None] Created volume successfully. Sep 02 12:48:04 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:48:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Deleted volume successfully. Sep 02 12:48:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12e0f6ec-4a61-49a9-9ef1-69529763e05d tempest-ServersNegativeTestJSON-836565740 None] Lock "cinder-026d1c36-1f87-463c-a152-41239ee2486f-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4b984c9a-cc63-4ebd-aac9-c4acb249a6e3 tempest-GroupSnapshotsTest-950438097 None] Update group completed successfully. Sep 02 12:48:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-94259cd2-56bc-4737-a901-e9a35a1e4ba3 tempest-GroupSnapshotsTest-950438097 None] Update group completed successfully. Sep 02 12:48:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c7b4d696-65d0-4650-b6a0-361133f058c0 tempest-GroupSnapshotsTest-950438097 None] Update group completed successfully. Sep 02 12:48:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d415f0a8-0802-49d6-a597-2216fe85b258 tempest-GroupSnapshotsTest-950438097 None] Update group completed successfully. Sep 02 12:48:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] GroupSnapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: creating. Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Group snapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Creating offline snapshot 0d30a5a0-9808-4961-8e92-b572102795eb of volume c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f0738-fafb-49e9-9755-035904899a45]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:09 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 Sep 02 12:48:09 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:10 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:10 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb 1G Sep 02 12:48:10 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:10 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb 1G" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:10 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb Sep 02 12:48:10 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:11 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:11 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb Sep 02 12:48:11 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:11 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:11 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info Sep 02 12:48:11 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:11 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:11 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info Sep 02 12:48:11 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:12 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.info" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Creating offline snapshot bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 of volume f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4b6b0-b408-47ec-83d4-2a383dec971a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:12 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 Sep 02 12:48:12 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:12 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5" returned: 0 in 0.447s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:12 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 1G Sep 02 12:48:12 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:13 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 1G" returned: 0 in 0.619s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92daa36-8356-4d32-9a19-64036110d0a5 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:13 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92daa36-8356-4d32-9a19-64036110d0a5 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 Sep 02 12:48:13 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:13 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92daa36-8356-4d32-9a19-64036110d0a5 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:13 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:13 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 Sep 02 12:48:13 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:13 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:13 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info Sep 02 12:48:13 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:14 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:14 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info Sep 02 12:48:14 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:14 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.info" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e1c4d5b6-b375-456e-86ac-70324629d9e7 tempest-GroupSnapshotsTest-950438097 None] group_snapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: created successfully Sep 02 12:48:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] group_snapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: deleting Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] group_snapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-0d30a5a0-9808-4961-8e92-b572102795eb" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-0d30a5a0-9808-4961-8e92-b572102795eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Deleting offline snapshot 0d30a5a0-9808-4961-8e92-b572102795eb of volume c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] snapshot_file for this snap is: volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238a220-1ed1-4687-aca8-dddbafeb551a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:15 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb Sep 02 12:48:15 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:15 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4023589-ef21-4d87-9fe7-ac95f99fd479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b2218-6fdf-4be0-96bc-89853b60eb1d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:15 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 Sep 02 12:48:15 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:16 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:16 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb Sep 02 12:48:16 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:16 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:16 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb Sep 02 12:48:16 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:16 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479.0d30a5a0-9808-4961-8e92-b572102795eb" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-0d30a5a0-9808-4961-8e92-b572102795eb" released by "_delete_snapshot" :: held 1.759s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" released by "delete_snapshot" :: held 1.787s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Deleting offline snapshot bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 of volume f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] snapshot_file for this snap is: volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359e369-d1e5-4a56-8bb7-06f18370127b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:17 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 Sep 02 12:48:17 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:17 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" returned: 0 in 0.409s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92daa36-8356-4d32-9a19-64036110d0a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b766e0-3684-4868-9281-1aed82b26b79]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:17 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 Sep 02 12:48:17 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:18 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:18 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 Sep 02 12:48:18 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:18 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:18 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9 Sep 02 12:48:18 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:18 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5.bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-bc0da3e5-32c8-410a-9a4c-ffec0bd8a5e9" released by "_delete_snapshot" :: held 1.728s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" released by "delete_snapshot" :: held 1.760s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:18 devstack cinder-volume[87092]: WARNING cinder.quota [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-787938656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-787938656, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:18 devstack cinder-volume[87092]: WARNING cinder.quota [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-787938656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-787938656, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Created reservations ['e6bed30b-d199-478e-a181-56ea616b3e3b', '51de4b3e-45e7-4963-8935-cd3b5ae125fc', 'b970b1d1-4193-4b93-898c-2f6b7fc6f17e', '4aba1076-e4f4-4dd9-91b0-f1fa48c82290'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] Created reservations ['b0922ae1-7bb0-4e4e-bd43-c9dcca76127d', '81e4bdcb-2695-464d-b374-e6c8448b9f5a', '5fd7a438-9704-4757-9b13-6bfa5c24e5ab', '05ea15c5-d44e-4b5d-810f-b38e89528068'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f1a857c-63c6-4863-9251-d4842f62b89c tempest-GroupSnapshotsTest-950438097 None] group_snapshot 9ee572ac-80cc-4e02-ac94-af42276b718f: deleted successfully Sep 02 12:48:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d13d879-286b-4df1-864f-d54812657ec1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:20 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 Sep 02 12:48:20 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:21 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479" returned: 0 in 0.585s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:21 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479 Sep 02 12:48:21 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:21 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c4023589-ef21-4d87-9fe7-ac95f99fd479" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-c4023589-ef21-4d87-9fe7-ac95f99fd479" released by "delete_volume" :: held 1.079s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e3059-2769-4a66-9982-33a04ac93769]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:21 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 Sep 02 12:48:21 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:22 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5" returned: 0 in 0.595s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:22 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5 Sep 02 12:48:22 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:22 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f92daa36-8356-4d32-9a19-64036110d0a5" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-f92daa36-8356-4d32-9a19-64036110d0a5" released by "delete_volume" :: held 0.993s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['56456b07-4d9b-4eac-999a-2cf63db15bf7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:22 devstack cinder-volume[87092]: WARNING cinder.quota [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-787938656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-787938656, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['240ca62d-fb62-4d0c-91bf-27753d9de38c', '16f039f5-c168-473d-a41a-92f04eec453d', '55758cc6-e75d-4315-b9fc-3ba3081be062', '9ffb4bb0-8c89-41ba-ba95-767e2f45a07e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Created reservations ['f267064e-bac7-47b3-9b82-e2d7559748c6', 'be614152-b226-4084-a09f-ab7b67d46f7e', '4c283c70-c1ca-46bb-8195-9daa38aabc09', 'c6474abc-f51b-4a75-9a45-2348585f7a96'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:23 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:48:23 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:23 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.442s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:48:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-57087adc-1066-4c95-b508-042d096021c4 tempest-GroupSnapshotsTest-950438097 None] Delete group completed successfully. Sep 02 12:48:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f9461af-ec4c-4728-b14d-0737af2eb96c tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-482638054: creating Sep 02 12:48:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f9461af-ec4c-4728-b14d-0737af2eb96c tempest-GroupSnapshotsTest-950438097 None] Group tempest-GroupSnapshotsTest-Group-482638054: created successfully Sep 02 12:48:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f9461af-ec4c-4728-b14d-0737af2eb96c tempest-GroupSnapshotsTest-950438097 None] Create group completed successfully. Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (32e9855a-d244-4ef5-993c-c53572618556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0322bf5b-32b7-4c36-ba3e-a416c5a392ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0322bf5b-32b7-4c36-ba3e-a416c5a392ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520661003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca028860-f878-49f8-9d78-08ac1be02a71,host='devstack@QuobyteHD#QuobyteHD',id=5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:26Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f01ec7b-7177-4166-91f9-4df73f4e5de4),volume_type_id=1f01ec7b-7177-4166-91f9-4df73f4e5de4)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5acbfd-8d16-41af-a18e-ef40d268e242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5acbfd-8d16-41af-a18e-ef40d268e242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532062d3-7407-49b7-9607-f3486fb8b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532062d3-7407-49b7-9607-f3486fb8b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6', 'volume_name': 'volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782252c9-670f-490f-97c6-fd709766bd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782252c9-670f-490f-97c6-fd709766bd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05298fe-c7a6-484f-b174-0256429924a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Volume 5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6', 'volume_size': 1} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca028860-f878-49f8-9d78-08ac1be02a71,created_at=2026-09-02T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-520661003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca028860-f878-49f8-9d78-08ac1be02a71,host='devstack@QuobyteHD#QuobyteHD',id=5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52c3d9786f4d9d91304d98520f0ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:26Z,use_quota=True,user_id='24619bc556804415b0862bc0ae15ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f01ec7b-7177-4166-91f9-4df73f4e5de4),volume_type_id=1f01ec7b-7177-4166-91f9-4df73f4e5de4)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Creating volume 5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:48:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:26 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 1073741824 Sep 02 12:48:26 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-19c44634-18ac-49fc-ae72-bc8cac4214ce req-919c5340-1499-4782-b1bf-2ddbd3f7307b tempest-ServerActionsTestOtherA-1400848441 None] Terminate volume connection completed successfully. Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-19c44634-18ac-49fc-ae72-bc8cac4214ce req-919c5340-1499-4782-b1bf-2ddbd3f7307b tempest-ServerActionsTestOtherA-1400848441 None] Deleting attachment 1f8e4211-a870-41a4-bbbf-3f120673a5b2. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:48:26 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 1073741824" returned: 0 in 0.924s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:27 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 Sep 02 12:48:27 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:27 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" returned: 0 in 0.509s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05298fe-c7a6-484f-b174-0256429924a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32a5a62-8dbf-4998-9f04-a610999c1063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Volume volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 (5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6): created successfully Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32a5a62-8dbf-4998-9f04-a610999c1063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Flow 'volume_create_manager' (32e9855a-d244-4ef5-993c-c53572618556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-edb4bd59-1731-4830-bf24-c35911e7485e tempest-GroupSnapshotsTest-950438097 None] Created volume successfully. Sep 02 12:48:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] GroupSnapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: creating. Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Group snapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Creating offline snapshot 0cc09a1c-54bf-4f67-9f2e-eba931fe2568 of volume 5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b87925f-cb03-469b-bdf1-2ac9a29ba350]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:29 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 Sep 02 12:48:29 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:29 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" returned: 0 in 0.686s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:30 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 1G Sep 02 12:48:30 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:30 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 1G" returned: 0 in 0.636s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:30 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 Sep 02 12:48:30 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:31 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568" returned: 0 in 0.650s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:31 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 Sep 02 12:48:31 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:31 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:31 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info Sep 02 12:48:31 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:32 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:48:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:32 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info Sep 02 12:48:32 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:32 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.info" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-35916994-6397-40ba-a30e-a61222f9b452 tempest-GroupSnapshotsTest-950438097 None] group_snapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: created successfully Sep 02 12:48:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] group_snapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: deleting Sep 02 12:48:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] group_snapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 12:48:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-0cc09a1c-54bf-4f67-9f2e-eba931fe2568" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-0cc09a1c-54bf-4f67-9f2e-eba931fe2568" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Deleting offline snapshot 0cc09a1c-54bf-4f67-9f2e-eba931fe2568 of volume 5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] snapshot_file for this snap is: volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac620e-d3ee-4649-be70-46f17f69228a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:34 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 Sep 02 12:48:34 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:34 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568" returned: 0 in 0.595s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761638e-2147-45ef-a544-e5eacd2d98a8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:34 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 Sep 02 12:48:34 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:35 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:35 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 Sep 02 12:48:35 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:35 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568" returned: 0 in 0.454s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:35 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568 Sep 02 12:48:35 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:36 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6.0cc09a1c-54bf-4f67-9f2e-eba931fe2568" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-0cc09a1c-54bf-4f67-9f2e-eba931fe2568" released by "_delete_snapshot" :: held 2.049s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" released by "delete_snapshot" :: held 2.104s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Flow 'volume_create_manager' (74b89bec-97f4-40bb-8292-f3a8764e4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19125070-5786-49c2-91b5-1641f5bebcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:36 devstack cinder-volume[87092]: WARNING cinder.quota [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-416688944 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-416688944, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:36 devstack cinder-volume[87092]: WARNING cinder.quota [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-416688944 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-416688944, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19125070-5786-49c2-91b5-1641f5bebcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-447694754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43613e61-d55c-4ab4-938e-d1c7b1418dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324b71018cc945bc97b1afcb68abd1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:36Z,use_quota=True,user_id='f4c07d7440034f21992bcae50c74f51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b1393-7341-43c6-a208-ded13885cf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b1393-7341-43c6-a208-ded13885cf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc4aad1-3d7e-4aaf-b8eb-2c8dd39d265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] Created reservations ['3653de01-5cf3-4aeb-8bdb-11a3e143834b', '8bf0e19f-92ce-4ebc-892d-debdc700d43f', '64a949aa-06a6-45b0-becc-a8b6163f1dab', 'ca448ff7-2a2a-4252-be08-93b5fbd6253e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab86bdbb-6f0d-465d-adea-b5606ab6152e tempest-GroupSnapshotsTest-950438097 None] group_snapshot 51a1bd1f-6de1-4647-b73f-83c86c54d469: deleted successfully Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc4aad1-3d7e-4aaf-b8eb-2c8dd39d265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'volume_name': 'volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3f8810-1ee2-43af-947a-848dba8eb1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3f8810-1ee2-43af-947a-848dba8eb1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a52d76f-9d51-4fe0-9546-b532d8677d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 12:48:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Trying to clone 43613e61-d55c-4ab4-938e-d1c7b1418dd3 from image 522e45ed-34d8-4082-932f-8d27db1e62a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:48:37 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Image download 20.69 MB at 20.69 MB/s Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf4529-b316-4782-ab2c-99e469f5bf67]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:37 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD Sep 02 12:48:37 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:37 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:48:37 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:37 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 is fetched for user f4c07d7440034f21992bcae50c74f51d. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[62467dd0-4eed-4a71-9f81-f56c491b0f11]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:37 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.569s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:48:37 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD Sep 02 12:48:37 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fdd304-726d-44e2-901b-93d2bcbd6f8e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:38 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-447694754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43613e61-d55c-4ab4-938e-d1c7b1418dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324b71018cc945bc97b1afcb68abd1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:36Z,use_quota=True,user_id='f4c07d7440034f21992bcae50c74f51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Creating volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:48:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:38 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 Sep 02 12:48:38 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:38 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1073741824 Sep 02 12:48:38 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:38 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" returned: 0 in 0.521s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:38 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6 Sep 02 12:48:38 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:39 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1073741824" returned: 0 in 0.702s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:39 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Lock "cinder-quobyte-5183eb8f-0b1f-45b7-a9fd-68a05b45aeb6" released by "delete_volume" :: held 1.051s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:39 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 Sep 02 12:48:39 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Created reservations ['fe77cced-e4b5-4c99-9543-a6c66f1541c3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:39 devstack cinder-volume[87092]: WARNING cinder.quota [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-416688944 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-416688944, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Created reservations ['a7e4223e-91fa-4e85-9aff-3808bc037342', '7eb50630-40e5-444b-b320-a5d928d4ebda', 'bb4b9ed5-e82c-4f09-ac5c-71e15313b380', 'f74e29f9-bf58-493a-8775-395775f3d09f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:40 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:48:40 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:40 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3" returned: 0 in 0.832s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Attempting download of 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5f4ad-cc17-4168-8bc7-2f619ea4f145]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:40 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:48:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f92217d5-bb2f-48eb-84e6-83b222c3e7fb tempest-GroupSnapshotsTest-950438097 None] Delete group completed successfully. Sep 02 12:48:40 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw Sep 02 12:48:40 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:40 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:41 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw Sep 02 12:48:41 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:41 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw" returned: 1 in 0.690s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_d4_1g4zw' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:48:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[89028ec3-9e18-4d8f-a449-be3ee707595e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:48:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:41 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD Sep 02 12:48:41 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:42 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:42 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] 522e45ed-34d8-4082-932f-8d27db1e62a2 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:48:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:42 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 Sep 02 12:48:42 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:44 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3" returned: 0 in 2.894s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:44 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_sdjg6iosdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:48:44 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Converted 112.00 MB image at 38.63 MB/s Sep 02 12:48:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:44 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1G Sep 02 12:48:44 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:45 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 1G" returned: 0 in 0.523s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Downloaded image 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 for user f4c07d7440034f21992bcae50c74f51d is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Marking volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Copying metadata from image 522e45ed-34d8-4082-932f-8d27db1e62a2 to 43613e61-d55c-4ab4-938e-d1c7b1418dd3. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Creating volume glance metadata for volume 43613e61-d55c-4ab4-938e-d1c7b1418dd3 backed by image 522e45ed-34d8-4082-932f-8d27db1e62a2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=119,cinder:UPDATE=136,cinder:INSERT=28,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a52d76f-9d51-4fe0-9546-b532d8677d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc980005-5e14-4425-99f8-486b8c5c7121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Volume volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 (43613e61-d55c-4ab4-938e-d1c7b1418dd3): created successfully Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc980005-5e14-4425-99f8-486b8c5c7121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Flow 'volume_create_manager' (74b89bec-97f4-40bb-8292-f3a8764e4284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f59683ff-3306-44b5-a352-f13dade79263 tempest-ServerActionsTestOtherA-1400848441 None] Created volume successfully. Sep 02 12:48:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-de5ee0f7-2e05-4895-af43-dd81fd802387 req-c83bcc5d-d2e1-4904-9653-3d55c0be92e5 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-de5ee0f7-2e05-4895-af43-dd81fd802387 req-c83bcc5d-d2e1-4904-9653-3d55c0be92e5 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-de5ee0f7-2e05-4895-af43-dd81fd802387 req-c83bcc5d-d2e1-4904-9653-3d55c0be92e5 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-de5ee0f7-2e05-4895-af43-dd81fd802387 req-c83bcc5d-d2e1-4904-9653-3d55c0be92e5 tempest-ServerActionsTestOtherA-1400848441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85069226-ae54-47d0-8524-43d7408d4a7f', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:48:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-de5ee0f7-2e05-4895-af43-dd81fd802387 req-c83bcc5d-d2e1-4904-9653-3d55c0be92e5 tempest-ServerActionsTestOtherA-1400848441 None] attachment_update completed successfully. Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (c0ae38e9-091e-4710-b692-ed41b8d56ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b82b6e-a06c-4e13-a044-c09a0281803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b82b6e-a06c-4e13-a044-c09a0281803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-34185849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd327a2-64dc-4c1e-a261-316cbf6ec802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:54Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9e96f7-10aa-4232-9288-11fcdecae736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9e96f7-10aa-4232-9288-11fcdecae736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83f86c7-19bf-41ad-b0e7-f38a42d1f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83f86c7-19bf-41ad-b0e7-f38a42d1f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd327a2-64dc-4c1e-a261-316cbf6ec802', 'volume_name': 'volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf09bfd-db69-4907-958e-9f61a0edcdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf09bfd-db69-4907-958e-9f61a0edcdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f223a-f0b9-47ad-95be-8beeb7db8521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Volume 1bd327a2-64dc-4c1e-a261-316cbf6ec802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802', 'volume_size': 1} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-34185849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd327a2-64dc-4c1e-a261-316cbf6ec802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:48:54Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Creating volume 1bd327a2-64dc-4c1e-a261-316cbf6ec802 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:48:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:48:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:54 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 1073741824 Sep 02 12:48:54 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:55 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 1073741824" returned: 0 in 0.808s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:48:55 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 Sep 02 12:48:55 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:48:56 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802" returned: 0 in 0.717s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f223a-f0b9-47ad-95be-8beeb7db8521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8cfc66-4cf2-46a4-933b-63f198a8c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:48:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Volume volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 (1bd327a2-64dc-4c1e-a261-316cbf6ec802): created successfully Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8cfc66-4cf2-46a4-933b-63f198a8c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:48:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (c0ae38e9-091e-4710-b692-ed41b8d56ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:48:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ce8db1db-8492-42cd-9c29-f9984008720d tempest-AttachVolumeTestJSON-1797836842 None] Created volume successfully. Sep 02 12:48:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-7cc17309-4ced-4f42-9ae7-c6590198ff66 req-4fb1c9a7-c233-456f-a5e5-fc9b9fa7cb40 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:48:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-7cc17309-4ced-4f42-9ae7-c6590198ff66 req-4fb1c9a7-c233-456f-a5e5-fc9b9fa7cb40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:48:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-7cc17309-4ced-4f42-9ae7-c6590198ff66 req-4fb1c9a7-c233-456f-a5e5-fc9b9fa7cb40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:48:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-7cc17309-4ced-4f42-9ae7-c6590198ff66 req-4fb1c9a7-c233-456f-a5e5-fc9b9fa7cb40 tempest-AttachVolumeTestJSON-1797836842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd1cdb75-d873-4577-aeda-136e918652c5', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:48:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-7cc17309-4ced-4f42-9ae7-c6590198ff66 req-4fb1c9a7-c233-456f-a5e5-fc9b9fa7cb40 tempest-AttachVolumeTestJSON-1797836842 None] attachment_update completed successfully. Sep 02 12:49:01 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=116,cinder:INSERT=35,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:49:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:49:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (6c742fd9-cb0b-4449-b5c9-0f5cf38f9f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79567830-cac3-4125-be60-7322dfd4818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79567830-cac3-4125-be60-7322dfd4818a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1366637016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd86526-81d2-4ca3-aff2-1c435493a406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:02Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebfe94c-32c0-49a0-b389-db1dd94c263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebfe94c-32c0-49a0-b389-db1dd94c263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4067738c-f169-4bfe-bbf2-e478142dc5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4067738c-f169-4bfe-bbf2-e478142dc5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd86526-81d2-4ca3-aff2-1c435493a406', 'volume_name': 'volume-ebd86526-81d2-4ca3-aff2-1c435493a406', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1e5c03-f8b7-492a-8d26-6d4e16ff862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1e5c03-f8b7-492a-8d26-6d4e16ff862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9e1125-ba60-467d-9601-a79030c05754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Volume ebd86526-81d2-4ca3-aff2-1c435493a406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd86526-81d2-4ca3-aff2-1c435493a406', 'volume_size': 1} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1366637016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd86526-81d2-4ca3-aff2-1c435493a406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb3ddf1e158488c93eb90cb410271b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:02Z,use_quota=True,user_id='bd1e46e32d1346f193d681854f63fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Creating volume ebd86526-81d2-4ca3-aff2-1c435493a406 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:49:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:02 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 1073741824 Sep 02 12:49:02 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:02 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 1073741824" returned: 0 in 0.763s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:03 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 Sep 02 12:49:03 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:03 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9e1125-ba60-467d-9601-a79030c05754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd86526-81d2-4ca3-aff2-1c435493a406', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c72f15-83af-4137-bbc7-3cddeb4e63be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Volume volume-ebd86526-81d2-4ca3-aff2-1c435493a406 (ebd86526-81d2-4ca3-aff2-1c435493a406): created successfully Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c72f15-83af-4137-bbc7-3cddeb4e63be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Flow 'volume_create_manager' (6c742fd9-cb0b-4449-b5c9-0f5cf38f9f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d5ef9759-3568-4e3e-8561-0d9b4685ce40 tempest-AttachVolumeTestJSON-1797836842 None] Created volume successfully. Sep 02 12:49:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2cb99edc-3e6d-4929-8d35-414861bab95a req-37fcf975-5c7f-4937-8678-1b8df67cee89 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2cb99edc-3e6d-4929-8d35-414861bab95a req-37fcf975-5c7f-4937-8678-1b8df67cee89 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2cb99edc-3e6d-4929-8d35-414861bab95a req-37fcf975-5c7f-4937-8678-1b8df67cee89 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-2cb99edc-3e6d-4929-8d35-414861bab95a req-37fcf975-5c7f-4937-8678-1b8df67cee89 tempest-AttachVolumeTestJSON-1797836842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-ebd86526-81d2-4ca3-aff2-1c435493a406', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cec6481-47db-4932-891f-d403f219085f', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:49:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-2cb99edc-3e6d-4929-8d35-414861bab95a req-37fcf975-5c7f-4937-8678-1b8df67cee89 tempest-AttachVolumeTestJSON-1797836842 None] attachment_update completed successfully. Sep 02 12:49:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-bf5078b6-3dba-4689-825f-4c386fbead3f tempest-ServerActionsTestOtherA-1400848441 None] Terminate volume connection completed successfully. Sep 02 12:49:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-bf5078b6-3dba-4689-825f-4c386fbead3f tempest-ServerActionsTestOtherA-1400848441 None] Deleting attachment 85069226-ae54-47d0-8524-43d7408d4a7f. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:49:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-4fe0382b-d350-4567-b7ac-5075cb3cc3df req-10947177-ac4c-4cdd-806b-b806447105f6 tempest-AttachVolumeTestJSON-1797836842 None] Terminate volume connection completed successfully. Sep 02 12:49:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-4fe0382b-d350-4567-b7ac-5075cb3cc3df req-10947177-ac4c-4cdd-806b-b806447105f6 tempest-AttachVolumeTestJSON-1797836842 None] Deleting attachment dd1cdb75-d873-4577-aeda-136e918652c5. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:49:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-ab116701-7de1-4b7f-9604-9f29bfcf6429 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-ab116701-7de1-4b7f-9604-9f29bfcf6429 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-ab116701-7de1-4b7f-9604-9f29bfcf6429 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-fab5e058-123d-4e5e-93f6-7c807ffd0f95 req-9c845eb4-3c40-42de-abb9-7c432cced7f9 tempest-AttachVolumeTestJSON-1797836842 None] Terminate volume connection completed successfully. Sep 02 12:49:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-fab5e058-123d-4e5e-93f6-7c807ffd0f95 req-9c845eb4-3c40-42de-abb9-7c432cced7f9 tempest-AttachVolumeTestJSON-1797836842 None] Deleting attachment 0cec6481-47db-4932-891f-d403f219085f. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-ab116701-7de1-4b7f-9604-9f29bfcf6429 tempest-ServerActionsTestOtherA-1400848441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f736aa97-e632-471d-b4fc-4b653caca7e3', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:49:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c7118e9d-7a05-4571-aaff-b76374ca88f7 req-ab116701-7de1-4b7f-9604-9f29bfcf6429 tempest-ServerActionsTestOtherA-1400848441 None] attachment_update completed successfully. Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Flow 'volume_create_manager' (0a8dc440-974c-449a-bb05-f36515361289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d34ffb-f9df-493f-bbc7-a8f8d7eb5c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d34ffb-f9df-493f-bbc7-a8f8d7eb5c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1179333630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc4bded-906e-44ea-9406-cd0caec35a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff06bf787501483982b60d94212ab235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:11Z,use_quota=True,user_id='6a1a0d9d107e4d23b2fdd6e3143d348d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca63d7c-4055-442a-9030-d8e82873c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca63d7c-4055-442a-9030-d8e82873c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698f630-49b2-4033-b1e3-057e672d5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698f630-49b2-4033-b1e3-057e672d5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc4bded-906e-44ea-9406-cd0caec35a9a', 'volume_name': 'volume-3dc4bded-906e-44ea-9406-cd0caec35a9a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9bd67-bff1-41ba-9c58-812ad0eef7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9bd67-bff1-41ba-9c58-812ad0eef7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcb4654-a818-479b-8a4d-8b1d6d3bee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Volume 3dc4bded-906e-44ea-9406-cd0caec35a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc4bded-906e-44ea-9406-cd0caec35a9a', 'volume_size': 1} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1179333630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc4bded-906e-44ea-9406-cd0caec35a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff06bf787501483982b60d94212ab235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:11Z,use_quota=True,user_id='6a1a0d9d107e4d23b2fdd6e3143d348d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Creating volume 3dc4bded-906e-44ea-9406-cd0caec35a9a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:49:11 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:49:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:11 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a 1073741824 Sep 02 12:49:11 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:12 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a 1073741824" returned: 0 in 1.145s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:12 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a Sep 02 12:49:12 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:12 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcb4654-a818-479b-8a4d-8b1d6d3bee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc4bded-906e-44ea-9406-cd0caec35a9a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7544f19b-0424-4e41-8a5c-9e165b9d6e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Volume volume-3dc4bded-906e-44ea-9406-cd0caec35a9a (3dc4bded-906e-44ea-9406-cd0caec35a9a): created successfully Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7544f19b-0424-4e41-8a5c-9e165b9d6e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Flow 'volume_create_manager' (0a8dc440-974c-449a-bb05-f36515361289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-23981c73-6c05-46e7-9034-a60dfd72f9cc tempest-AttachVolumeShelveTestJSON-266229927 None] Created volume successfully. Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-ebd86526-81d2-4ca3-aff2-1c435493a406-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-ebd86526-81d2-4ca3-aff2-1c435493a406-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-quobyte-ebd86526-81d2-4ca3-aff2-1c435493a406" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-ebd86526-81d2-4ca3-aff2-1c435493a406" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[df82cd61-51cf-4ab8-b8f5-141e989dfdcf]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:18 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 Sep 02 12:49:18 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:19 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406" returned: 0 in 0.543s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:19 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406 Sep 02 12:49:19 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:19 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebd86526-81d2-4ca3-aff2-1c435493a406" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-ebd86526-81d2-4ca3-aff2-1c435493a406" released by "delete_volume" :: held 1.061s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Created reservations ['6e3453bf-4edd-4992-a40a-f6973e7a157e', 'c24f8236-dbbf-4f54-9a97-71364a730cbf', 'f316655d-6f3f-46c5-b384-d3d397a44593', 'dcc9c145-8a0d-4e83-b485-248a165c8052'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:19 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:19 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:20 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Deleted volume successfully. Sep 02 12:49:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-756fc017-08ab-46ec-9659-f4997d3a37f5 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-ebd86526-81d2-4ca3-aff2-1c435493a406-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-1bd327a2-64dc-4c1e-a261-316cbf6ec802-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-1bd327a2-64dc-4c1e-a261-316cbf6ec802-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-quobyte-1bd327a2-64dc-4c1e-a261-316cbf6ec802" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-1bd327a2-64dc-4c1e-a261-316cbf6ec802" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6611bf-e541-4f20-a230-b27d881938f2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:21 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 Sep 02 12:49:21 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:21 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802" returned: 0 in 0.611s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:21 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802 Sep 02 12:49:21 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:22 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1bd327a2-64dc-4c1e-a261-316cbf6ec802" returned: 0 in 0.416s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-1bd327a2-64dc-4c1e-a261-316cbf6ec802" released by "delete_volume" :: held 1.130s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Created reservations ['5259cc4a-3d88-4adc-9a89-c65eb768445e', '12e7a545-f68a-4caf-a50b-c9eac3da506e', '4dd4addc-ec37-4a9e-87dc-fbe84a269b86', '1cdd9356-449c-4291-bf0c-1e3df582406b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:22 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:22 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:22 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Deleted volume successfully. Sep 02 12:49:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-59618d33-aad3-4b0e-80a6-d1a9f0798df4 tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-1bd327a2-64dc-4c1e-a261-316cbf6ec802-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-12bf1138-5d50-41f9-96f1-8bc0a8436e69-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-12bf1138-5d50-41f9-96f1-8bc0a8436e69-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "cinder-quobyte-12bf1138-5d50-41f9-96f1-8bc0a8436e69" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-12bf1138-5d50-41f9-96f1-8bc0a8436e69" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b82af-d00a-4123-b7e3-0814f5646f3b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:23 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 Sep 02 12:49:23 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:24 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69" returned: 0 in 0.534s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:24 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69 Sep 02 12:49:24 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:24 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-12bf1138-5d50-41f9-96f1-8bc0a8436e69" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-quobyte-12bf1138-5d50-41f9-96f1-8bc0a8436e69" released by "delete_volume" :: held 0.937s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Created reservations ['49b24693-dff8-4125-b9c6-54ffc12e9320', '75343747-5f43-4540-9b40-70a44a6fe3ec', 'f786e0ab-a751-4fe7-a394-df988a51b473', 'f1d29811-403e-42bc-808c-fe9b335d5d5f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:24 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:24 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:25 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Deleted volume successfully. Sep 02 12:49:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5824bb47-d7a3-4593-8702-c5c0f5d01aaf tempest-AttachVolumeTestJSON-1797836842 None] Lock "cinder-12bf1138-5d50-41f9-96f1-8bc0a8436e69-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Flow 'volume_create_manager' (fbfa8369-9f7d-4b10-ab0f-1d689b2da438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca25884-23dd-4fa8-a514-0a9ca316946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca25884-23dd-4fa8-a514-0a9ca316946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1209664868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63284c4-1aef-40dd-ad7b-e7350caa4df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d911ac0783e46eba61dfe01fd3e1676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:27Z,use_quota=True,user_id='4a1b386529a54b99abe18541b9d8e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a35afc-5005-4fe2-9e73-438ad48d7178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a35afc-5005-4fe2-9e73-438ad48d7178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a06ec6-d930-4b01-a713-5ed37b240201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a06ec6-d930-4b01-a713-5ed37b240201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63284c4-1aef-40dd-ad7b-e7350caa4df5', 'volume_name': 'volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61b7bb7-7190-4165-b8ee-52424d027469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61b7bb7-7190-4165-b8ee-52424d027469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f619538c-b674-4924-8363-b4f1d8d169ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume d63284c4-1aef-40dd-ad7b-e7350caa4df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5', 'volume_size': 1} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1209664868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63284c4-1aef-40dd-ad7b-e7350caa4df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d911ac0783e46eba61dfe01fd3e1676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:27Z,use_quota=True,user_id='4a1b386529a54b99abe18541b9d8e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Creating volume d63284c4-1aef-40dd-ad7b-e7350caa4df5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:49:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:27 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 1073741824 Sep 02 12:49:27 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:27 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 1073741824" returned: 0 in 0.582s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:27 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 Sep 02 12:49:27 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:28 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f619538c-b674-4924-8363-b4f1d8d169ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2365e7c5-a4b0-4652-b085-a940af9b8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 (d63284c4-1aef-40dd-ad7b-e7350caa4df5): created successfully Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2365e7c5-a4b0-4652-b085-a940af9b8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Flow 'volume_create_manager' (fbfa8369-9f7d-4b10-ab0f-1d689b2da438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-76f68325-9659-4f33-9837-dfd9345b749f tempest-VolumeQuotasAdminTestJSON-687636363 None] Created volume successfully. Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bedd9d4-114b-4d8e-8a89-01b61929b81a req-dd842439-9461-4006-8f97-6d4ac562472d tempest-AttachVolumeShelveTestJSON-266229927 None] No connector for attachment 66a7ff9e-c7a2-4ddb-8054-750304bc3132; skipping storage backend terminate_connection call. {{(pid=87092) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 02 12:49:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bedd9d4-114b-4d8e-8a89-01b61929b81a req-dd842439-9461-4006-8f97-6d4ac562472d tempest-AttachVolumeShelveTestJSON-266229927 None] Deleting attachment 66a7ff9e-c7a2-4ddb-8054-750304bc3132. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "cinder-d63284c4-1aef-40dd-ad7b-e7350caa4df5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "cinder-d63284c4-1aef-40dd-ad7b-e7350caa4df5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "cinder-quobyte-d63284c4-1aef-40dd-ad7b-e7350caa4df5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "cinder-quobyte-d63284c4-1aef-40dd-ad7b-e7350caa4df5" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b31ee-39cc-4623-938e-52a985d137a5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:29 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 Sep 02 12:49:29 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:29 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:29 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5 Sep 02 12:49:29 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:30 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d63284c4-1aef-40dd-ad7b-e7350caa4df5" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "cinder-quobyte-d63284c4-1aef-40dd-ad7b-e7350caa4df5" released by "delete_volume" :: held 0.847s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Created reservations ['ee964983-263f-4be0-9c99-48627eda0a55', 'fb8186d8-a59f-4e2d-8830-dd4c8692e875', '633868e2-2c85-4fe1-a818-829462604d01', 'c159e843-3500-49e2-93b7-7dde6ad70fcc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:30 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:30 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:30 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Deleted volume successfully. Sep 02 12:49:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-715424b6-7ba1-4e21-af78-0914ecd3282a tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "cinder-d63284c4-1aef-40dd-ad7b-e7350caa4df5-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Flow 'volume_create_manager' (5011c067-6696-4278-9730-2147d17dda66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d5dfcf-6484-412c-a312-16efb8e275c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d5dfcf-6484-412c-a312-16efb8e275c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1533371467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc1c33-02ea-4f46-b20b-193a25464da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d911ac0783e46eba61dfe01fd3e1676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:31Z,use_quota=True,user_id='4a1b386529a54b99abe18541b9d8e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0594587-a17a-4641-993b-529728511cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0594587-a17a-4641-993b-529728511cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d841c353-cf5d-4894-85a1-e2d165f5313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d841c353-cf5d-4894-85a1-e2d165f5313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bc1c33-02ea-4f46-b20b-193a25464da2', 'volume_name': 'volume-e3bc1c33-02ea-4f46-b20b-193a25464da2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f603378-d71c-4a44-beea-1dc68e2c9b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f603378-d71c-4a44-beea-1dc68e2c9b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc90103-0bdb-4aa4-8ee3-6a90aeb03116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:31 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume e3bc1c33-02ea-4f46-b20b-193a25464da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bc1c33-02ea-4f46-b20b-193a25464da2', 'volume_size': 1} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1533371467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc1c33-02ea-4f46-b20b-193a25464da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d911ac0783e46eba61dfe01fd3e1676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:31Z,use_quota=True,user_id='4a1b386529a54b99abe18541b9d8e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Creating volume e3bc1c33-02ea-4f46-b20b-193a25464da2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:49:31 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:49:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:31 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 1073741824 Sep 02 12:49:31 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:32 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 1073741824" returned: 0 in 0.658s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:32 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 Sep 02 12:49:32 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:32 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc90103-0bdb-4aa4-8ee3-6a90aeb03116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bc1c33-02ea-4f46-b20b-193a25464da2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e909382-13c7-4947-b954-01f157dabd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Volume volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 (e3bc1c33-02ea-4f46-b20b-193a25464da2): created successfully Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e909382-13c7-4947-b954-01f157dabd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Flow 'volume_create_manager' (5011c067-6696-4278-9730-2147d17dda66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1a1b61d5-92bf-4c29-85fe-74c6a8d6ee2f tempest-VolumeQuotasAdminTestJSON-687636363 None] Created volume successfully. Sep 02 12:49:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cf0ccc8a-0759-4e23-8f7b-42ccebcca567 tempest-VolumeQuotasAdminTestJSON-1598566531 None] Transfer volume completed successfully. Sep 02 12:49:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Acquiring lock "cinder-e3bc1c33-02ea-4f46-b20b-193a25464da2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "cinder-e3bc1c33-02ea-4f46-b20b-193a25464da2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Acquiring lock "cinder-quobyte-e3bc1c33-02ea-4f46-b20b-193a25464da2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "cinder-quobyte-e3bc1c33-02ea-4f46-b20b-193a25464da2" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07695f-fae8-4893-a0eb-d77eae520e3a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:35 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 Sep 02 12:49:35 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:35 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:35 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2 Sep 02 12:49:35 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:35 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e3bc1c33-02ea-4f46-b20b-193a25464da2" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "cinder-quobyte-e3bc1c33-02ea-4f46-b20b-193a25464da2" released by "delete_volume" :: held 0.846s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:35 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Created reservations ['82c74ba8-7653-4648-ae92-51b1c468652b', '9d006fee-5c11-4bd1-8219-80f689b0cc98', 'c7bba04e-40b3-497b-8ed2-180f2ad2f36a', '360c5a3b-7058-4d34-b5e1-41f0d1da5a80'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:36 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:36 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:36 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Deleted volume successfully. Sep 02 12:49:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bf8d9c3-e420-4e91-ace8-8eb601c90953 tempest-VolumeQuotasAdminTestJSON-1833195770 None] Lock "cinder-e3bc1c33-02ea-4f46-b20b-193a25464da2-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:37 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:37 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:37 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:49:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:49:46 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:INSERT=15,cinder:SELECT=69,cinder:UPDATE=57,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:49:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-704ac1f7-6189-4eb7-9c84-0cf99355f89a tempest-ServerActionsTestOtherA-1400848441 None] Terminate volume connection completed successfully. Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-704ac1f7-6189-4eb7-9c84-0cf99355f89a tempest-ServerActionsTestOtherA-1400848441 None] Deleting attachment f736aa97-e632-471d-b4fc-4b653caca7e3. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "cinder-43613e61-d55c-4ab4-938e-d1c7b1418dd3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-43613e61-d55c-4ab4-938e-d1c7b1418dd3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "cinder-quobyte-43613e61-d55c-4ab4-938e-d1c7b1418dd3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-quobyte-43613e61-d55c-4ab4-938e-d1c7b1418dd3" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e2d6e-8a31-46bd-90c5-21f4152313cb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:50 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 Sep 02 12:49:50 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:51 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3" returned: 0 in 0.715s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:51 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3 Sep 02 12:49:51 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:51 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-43613e61-d55c-4ab4-938e-d1c7b1418dd3" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-quobyte-43613e61-d55c-4ab4-938e-d1c7b1418dd3" released by "delete_volume" :: held 1.138s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "cinder-d9f96f05-bd41-4f59-881f-97a0ba2a1c35-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG cinder.quota [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Created reservations ['71d10820-2797-4cad-a999-e94af1c9d17f', 'd718c3cd-8958-4cb6-ac46-b162c36d0240', '14e272e5-6e35-4ada-8d75-a1ab34d596d3', '8b4fabd6-ea5f-40d5-9c57-70b80a2c33f1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-d9f96f05-bd41-4f59-881f-97a0ba2a1c35-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "cinder-quobyte-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-quobyte-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[65232ac0-89f7-4eca-bc12-5d69323c5eaa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:52 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:52 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:52 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 Sep 02 12:49:52 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:52 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG cinder.manager [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Deleted volume successfully. Sep 02 12:49:52 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-1a000203-f2e6-4f11-96af-dcd30a66079f req-652b16df-79b9-454d-90cf-bde206eac832 tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-43613e61-d55c-4ab4-938e-d1c7b1418dd3-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" returned: 0 in 0.587s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:52 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35 Sep 02 12:49:52 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:53 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" returned: 0 in 0.438s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-quobyte-d9f96f05-bd41-4f59-881f-97a0ba2a1c35" released by "delete_volume" :: held 1.097s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Created reservations ['301801f6-d79f-4e8f-bb98-de416bdada23', '5e40c3b1-2db1-4b81-887d-6d5d9b48f1e9', '06d84329-c035-4851-a9c4-828ad21d069d', '5fe78ee5-f777-470a-ae0d-fbe7e3691f1c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:53 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:49:53 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:53 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:49:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Deleted volume successfully. Sep 02 12:49:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bf7542c1-e219-44e1-a6ac-d35574b16e5a tempest-ServerActionsTestOtherA-1400848441 None] Lock "cinder-d9f96f05-bd41-4f59-881f-97a0ba2a1c35-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:49:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Flow 'volume_create_manager' (7463c1f1-4932-4eae-abc7-0b7f5defc3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4884d0b-a38b-48fd-9da8-9b8a74bf5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4884d0b-a38b-48fd-9da8-9b8a74bf5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1405358149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d445602-027d-46d1-8a83-1c5582c92a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86409d5a66bd47c4a44dd4dd8224357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:58Z,use_quota=True,user_id='7f32712a187b4479aaf88caea35268c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee47e53-b3cf-433c-90a0-8b8f73de8fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee47e53-b3cf-433c-90a0-8b8f73de8fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8772b-cd6c-4cbd-8666-7b2a866bcf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8772b-cd6c-4cbd-8666-7b2a866bcf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d445602-027d-46d1-8a83-1c5582c92a0e', 'volume_name': 'volume-1d445602-027d-46d1-8a83-1c5582c92a0e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e8df8c-4ebb-4818-b844-052865701906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e8df8c-4ebb-4818-b844-052865701906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca2151d-5cc3-4cb0-a85f-c22b5c5e0555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Volume 1d445602-027d-46d1-8a83-1c5582c92a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d445602-027d-46d1-8a83-1c5582c92a0e', 'volume_size': 1} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1405358149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d445602-027d-46d1-8a83-1c5582c92a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86409d5a66bd47c4a44dd4dd8224357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:49:58Z,use_quota=True,user_id='7f32712a187b4479aaf88caea35268c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Creating volume 1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:49:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:58 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e 1073741824 Sep 02 12:49:58 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:58 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e 1073741824" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:49:58 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e Sep 02 12:49:58 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:49:58 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca2151d-5cc3-4cb0-a85f-c22b5c5e0555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d445602-027d-46d1-8a83-1c5582c92a0e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650c6fb3-1ec1-42db-9b23-b14616e03c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:49:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Volume volume-1d445602-027d-46d1-8a83-1c5582c92a0e (1d445602-027d-46d1-8a83-1c5582c92a0e): created successfully Sep 02 12:49:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650c6fb3-1ec1-42db-9b23-b14616e03c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:49:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Flow 'volume_create_manager' (7463c1f1-4932-4eae-abc7-0b7f5defc3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:49:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-475e5c6c-ca7f-4782-8c7c-9db522fbb04d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Created volume successfully. Sep 02 12:50:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Creating offline snapshot 586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 of volume 1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:50:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f5064e-f586-4d3e-933d-efe8858c9c85]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:00 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e Sep 02 12:50:00 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:01 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e" returned: 0 in 0.446s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:01 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 1G Sep 02 12:50:01 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:01 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 1G" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d445602-027d-46d1-8a83-1c5582c92a0e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:01 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d445602-027d-46d1-8a83-1c5582c92a0e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 Sep 02 12:50:01 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:02 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d445602-027d-46d1-8a83-1c5582c92a0e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 is being set with open permissions: ugo+rw Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:02 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 Sep 02 12:50:02 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:02 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=63,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:02 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info Sep 02 12:50:02 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:02 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info" returned: 0 in 0.367s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info is being set with open permissions: ugo+rw Sep 02 12:50:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:02 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info Sep 02 12:50:02 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:03 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.info" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-92fa8905-d840-4c5a-a321-28e5aaa6462d tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Create snapshot completed successfully Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "cinder-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "cinder-quobyte-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Deleting offline snapshot 586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 of volume 1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] snapshot_file for this snap is: volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f94b4-831a-4a11-ac37-f90e175c1cb3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:04 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 Sep 02 12:50:04 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:05 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" returned: 0 in 0.553s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d445602-027d-46d1-8a83-1c5582c92a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376010f-842a-4eff-87bd-b2e98145f927]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:05 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e Sep 02 12:50:05 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:05 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e" returned: 0 in 0.490s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:05 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 Sep 02 12:50:05 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:06 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:06 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1 Sep 02 12:50:06 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:06 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e.586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1" released by "_delete_snapshot" :: held 1.875s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" released by "delete_snapshot" :: held 1.909s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:06 devstack cinder-volume[87092]: WARNING cinder.quota [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Created reservations ['5ca39a04-48a4-49f7-b32c-d6074d0a463d', 'ba45311c-21c1-4833-a293-c4444b1e8ad7', '3eb54dca-256f-4800-ace4-decb7d3a4ae5', 'b6c8268b-fcb0-4563-8cf3-6117faf8e74d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Delete snapshot completed successfully. Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bad470d4-b286-4e1c-beac-6444afaf1434 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-586d8d95-fda3-42e9-aebf-4e8d8f68b7e1-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "cinder-1d445602-027d-46d1-8a83-1c5582c92a0e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-1d445602-027d-46d1-8a83-1c5582c92a0e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0310f5-8e0d-4759-b6eb-6a399db6dff2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:07 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e Sep 02 12:50:07 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:07 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e" returned: 0 in 0.705s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:07 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e Sep 02 12:50:07 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:08 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d445602-027d-46d1-8a83-1c5582c92a0e" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-quobyte-1d445602-027d-46d1-8a83-1c5582c92a0e" released by "delete_volume" :: held 1.320s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Created reservations ['cf0f41f5-49e1-4dd7-b55c-54092c3775f2', '04712a6d-416a-47f4-b1e3-57a5e21a08d7', 'f2f8e65a-bea5-464d-9f9b-6f1e0167f79e', 'ba74c4a6-0dc6-4b65-b20b-294acd2f58de'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:08 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:08 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Flow 'volume_create_manager' (22309d4b-003b-4278-a245-71fd69933107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fdb4ca-0265-4729-b4f3-49f24f223b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fdb4ca-0265-4729-b4f3-49f24f223b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-929397139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3324b3fb-bcf9-421c-9d45-949f5210d588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db46bf37bfe4a1db8d6434d3553aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:09Z,use_quota=True,user_id='37380b99d26f46a895d59a55d60ab9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8231a96-f068-4554-9d28-800d2781540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8231a96-f068-4554-9d28-800d2781540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b36152c-fd0d-4143-99ab-e5fdbc844b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b36152c-fd0d-4143-99ab-e5fdbc844b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3324b3fb-bcf9-421c-9d45-949f5210d588', 'volume_name': 'volume-3324b3fb-bcf9-421c-9d45-949f5210d588', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70251db6-f9d6-4d24-92f8-b88080fe6286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70251db6-f9d6-4d24-92f8-b88080fe6286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebcfd4d-bef6-46e1-bb1b-b37c760e00d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Volume 3324b3fb-bcf9-421c-9d45-949f5210d588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3324b3fb-bcf9-421c-9d45-949f5210d588', 'volume_size': 1} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-929397139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3324b3fb-bcf9-421c-9d45-949f5210d588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db46bf37bfe4a1db8d6434d3553aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:09Z,use_quota=True,user_id='37380b99d26f46a895d59a55d60ab9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Creating volume 3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:08 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 1073741824 Sep 02 12:50:08 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:08 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Deleted volume successfully. Sep 02 12:50:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0042b5a-d276-4f84-b85b-d3b50094de07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2029658598 None] Lock "cinder-1d445602-027d-46d1-8a83-1c5582c92a0e-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:09 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 1073741824" returned: 0 in 0.671s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:09 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 Sep 02 12:50:09 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:09 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebcfd4d-bef6-46e1-bb1b-b37c760e00d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3324b3fb-bcf9-421c-9d45-949f5210d588', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bc343d-fc22-4402-b499-49041eec0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Volume volume-3324b3fb-bcf9-421c-9d45-949f5210d588 (3324b3fb-bcf9-421c-9d45-949f5210d588): created successfully Sep 02 12:50:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bc343d-fc22-4402-b499-49041eec0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Flow 'volume_create_manager' (22309d4b-003b-4278-a245-71fd69933107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-65ea7cf9-9ba1-425b-b18d-90a0dcb6cff0 req-c3a9cebc-54a7-4061-adf0-adbc288a22f3 tempest-VolumesSnapshotsTestJSON-436199847 None] Created volume successfully. Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Creating offline snapshot ff1f0db9-fdf6-4067-96c1-3879b1b2255f of volume 3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab429f81-89da-435c-9d80-2b6241ba09b4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:11 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 Sep 02 12:50:11 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:11 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588" returned: 0 in 0.649s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:11 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f 1G Sep 02 12:50:11 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:12 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f 1G" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3324b3fb-bcf9-421c-9d45-949f5210d588 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:12 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3324b3fb-bcf9-421c-9d45-949f5210d588 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f Sep 02 12:50:12 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Acquiring lock "cinder-3dc4bded-906e-44ea-9406-cd0caec35a9a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "cinder-3dc4bded-906e-44ea-9406-cd0caec35a9a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Acquiring lock "cinder-quobyte-3dc4bded-906e-44ea-9406-cd0caec35a9a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "cinder-quobyte-3dc4bded-906e-44ea-9406-cd0caec35a9a" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:12 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3324b3fb-bcf9-421c-9d45-949f5210d588 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f is being set with open permissions: ugo+rw Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba012c73-afa6-4f95-833a-056e1ef20bf9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:12 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f Sep 02 12:50:12 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:13 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a Sep 02 12:50:13 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:13 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:13 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info Sep 02 12:50:13 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:13 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a" returned: 0 in 0.496s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:13 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a Sep 02 12:50:13 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:13 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info" returned: 0 in 0.328s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:13 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info is being set with open permissions: ugo+rw Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:13 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info Sep 02 12:50:13 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:13 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3dc4bded-906e-44ea-9406-cd0caec35a9a" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "cinder-quobyte-3dc4bded-906e-44ea-9406-cd0caec35a9a" released by "delete_volume" :: held 0.908s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Created reservations ['30c17b65-94af-45ba-a9d2-c8e857cebf01', '4bb6c93e-62f5-40dc-b75f-d82e63a8ebb8', '27a4396c-f03f-4d32-bb18-eef1d5721aea', '7a0c464f-b0b6-4340-aac2-8df46690a03e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:13 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.info" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-0084d6bf-a167-492e-b824-5c16c0dd9eb4 req-e575089a-628e-4128-9ecf-15d53987fb39 tempest-VolumesSnapshotsTestJSON-436199847 None] Create snapshot completed successfully Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:14 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:14 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:14 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:14 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Deleted volume successfully. Sep 02 12:50:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f8eb2f7-9b41-4f8c-90f6-30df3b7241d5 tempest-AttachVolumeShelveTestJSON-266229927 None] Lock "cinder-3dc4bded-906e-44ea-9406-cd0caec35a9a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "cinder-ff1f0db9-fdf6-4067-96c1-3879b1b2255f-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-ff1f0db9-fdf6-4067-96c1-3879b1b2255f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "cinder-quobyte-ff1f0db9-fdf6-4067-96c1-3879b1b2255f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-ff1f0db9-fdf6-4067-96c1-3879b1b2255f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Deleting offline snapshot ff1f0db9-fdf6-4067-96c1-3879b1b2255f of volume 3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] snapshot_file for this snap is: volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66ff800-90d5-456e-bf95-fc048fbe61a3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:15 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f Sep 02 12:50:15 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:15 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3324b3fb-bcf9-421c-9d45-949f5210d588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd16036-aff7-4ffa-81c9-c4ec9f1a3715]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:15 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 Sep 02 12:50:15 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (a3c3f5d2-bfcb-4674-a73a-a07904de0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b391f20-7af4-4303-8e44-24b603a3341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b391f20-7af4-4303-8e44-24b603a3341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1683466464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fef6278-e902-4d50-a718-bb7d22b12aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:16Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bbdea-4260-4b88-b2b7-486d8588421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bbdea-4260-4b88-b2b7-486d8588421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06c7a70-ada8-49bc-bee3-c448798a00e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06c7a70-ada8-49bc-bee3-c448798a00e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fef6278-e902-4d50-a718-bb7d22b12aea', 'volume_name': 'volume-4fef6278-e902-4d50-a718-bb7d22b12aea', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cf8bc2-30d0-404d-8632-68402d06bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cf8bc2-30d0-404d-8632-68402d06bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0a9fb-e583-454e-a18f-9d3ff7021d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Volume 4fef6278-e902-4d50-a718-bb7d22b12aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fef6278-e902-4d50-a718-bb7d22b12aea', 'volume_size': 1} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1683466464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fef6278-e902-4d50-a718-bb7d22b12aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:16Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Creating volume 4fef6278-e902-4d50-a718-bb7d22b12aea {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:16 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea 1073741824 Sep 02 12:50:16 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:16 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f Sep 02 12:50:16 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:16 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:16 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f Sep 02 12:50:16 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:16 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea 1073741824" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:16 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea Sep 02 12:50:16 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:16 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588.ff1f0db9-fdf6-4067-96c1-3879b1b2255f" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-ff1f0db9-fdf6-4067-96c1-3879b1b2255f" released by "_delete_snapshot" :: held 1.706s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" released by "delete_snapshot" :: held 1.746s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.quota [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Created reservations ['c0485f4f-7677-4a11-a3a9-49729a8c2923', '8c0116d9-d7a0-4b30-bfae-fd7eb8a36e81', 'ca138b49-7e22-463d-b4ba-776b370d2e7f', 'ecd53d7f-23c7-41e0-8029-e521194db301'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:16 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad0a9fb-e583-454e-a18f-9d3ff7021d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fef6278-e902-4d50-a718-bb7d22b12aea', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f998f905-37d5-4a81-9dd1-9fc0d8fb0940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Volume volume-4fef6278-e902-4d50-a718-bb7d22b12aea (4fef6278-e902-4d50-a718-bb7d22b12aea): created successfully Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f998f905-37d5-4a81-9dd1-9fc0d8fb0940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (a3c3f5d2-bfcb-4674-a73a-a07904de0eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Delete snapshot completed successfully. Sep 02 12:50:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-514d21bd-8e8b-4c20-9be8-63f4f4d05bcd tempest-VolumesListAdminTestJSON-1523939214 None] Created volume successfully. Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-8f0693f7-47c0-4350-8af6-d88e3dc4ee1b req-4407aad5-7054-45f4-9d0f-fac0403a0dc9 tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-ff1f0db9-fdf6-4067-96c1-3879b1b2255f-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "cinder-3324b3fb-bcf9-421c-9d45-949f5210d588-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-3324b3fb-bcf9-421c-9d45-949f5210d588-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[33115ad2-532f-41cf-9f42-2db34475dbf7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:17 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 Sep 02 12:50:17 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:17 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:17 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588 Sep 02 12:50:17 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:18 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3324b3fb-bcf9-421c-9d45-949f5210d588" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-quobyte-3324b3fb-bcf9-421c-9d45-949f5210d588" released by "delete_volume" :: held 0.740s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.quota [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Created reservations ['4495b1db-43cd-4064-8ed1-3998b7171c8a', '5d23a8ee-5517-40f0-90d5-fc3c9a6d816c', 'eeec188e-57da-4e9e-9893-f879c1081f99', '69c55edf-eb25-4c5b-88bb-f752872cd9ed'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:18 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:18 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:18 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.manager [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Deleted volume successfully. Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-75d16b7d-c588-4d8e-911e-be27b34f49fd req-a665c0b9-0303-4dcd-ae3b-ff78d72ec7da tempest-VolumesSnapshotsTestJSON-436199847 None] Lock "cinder-3324b3fb-bcf9-421c-9d45-949f5210d588-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (e673785f-98b2-4882-89cc-68f3266e9d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77613317-5c49-4122-a325-0cd15e71aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77613317-5c49-4122-a325-0cd15e71aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-180922163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:19Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f14b5b-aab7-4eac-bdb1-6b2de714fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f14b5b-aab7-4eac-bdb1-6b2de714fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23230e9c-b908-450a-82cd-abd7cff47d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23230e9c-b908-450a-82cd-abd7cff47d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2', 'volume_name': 'volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ddbc7f-2b41-4509-a7fe-d5c1b4213c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ddbc7f-2b41-4509-a7fe-d5c1b4213c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad6b7c9-c554-4ee4-a07c-64fa6e4bd479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Volume 3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2', 'volume_size': 1} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-180922163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:19Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Creating volume 3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:18 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 1073741824 Sep 02 12:50:18 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:19 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 1073741824" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:19 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 Sep 02 12:50:19 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:19 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad6b7c9-c554-4ee4-a07c-64fa6e4bd479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f770c-5fd8-4761-8f89-02ad586f625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Volume volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 (3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2): created successfully Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f770c-5fd8-4761-8f89-02ad586f625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (e673785f-98b2-4882-89cc-68f3266e9d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff44d72c-b06e-4238-8d5f-9cc1179bd4e3 tempest-VolumesListAdminTestJSON-1523939214 None] Created volume successfully. Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (82aab8b8-eb48-48e4-92f2-175e64b1a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8b76f5-8b9e-4f3b-bf6f-f005354f454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8b76f5-8b9e-4f3b-bf6f-f005354f454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1336211853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207d0c7b-8eef-4791-b79a-30ae3025af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:21Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1946cd53-e750-457c-ac87-a6f31a8f61e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1946cd53-e750-457c-ac87-a6f31a8f61e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd6d821-1ab0-44f5-8384-1db08ed16948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd6d821-1ab0-44f5-8384-1db08ed16948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207d0c7b-8eef-4791-b79a-30ae3025af6d', 'volume_name': 'volume-207d0c7b-8eef-4791-b79a-30ae3025af6d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eac1d40-1d0b-4e47-ae21-32296cd77a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eac1d40-1d0b-4e47-ae21-32296cd77a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30f9be-a093-48b1-aaeb-05a2b1849977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Volume 207d0c7b-8eef-4791-b79a-30ae3025af6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207d0c7b-8eef-4791-b79a-30ae3025af6d', 'volume_size': 1} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1336211853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207d0c7b-8eef-4791-b79a-30ae3025af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34590095708b4e9e99c50ba8325fc6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:21Z,use_quota=True,user_id='b397baff7664407caa85fd22dfad9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Creating volume 207d0c7b-8eef-4791-b79a-30ae3025af6d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:21 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d 1073741824 Sep 02 12:50:21 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:22 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d 1073741824" returned: 0 in 0.525s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:22 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d Sep 02 12:50:22 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:22 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30f9be-a093-48b1-aaeb-05a2b1849977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207d0c7b-8eef-4791-b79a-30ae3025af6d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440d59c-e9e2-40ab-b144-10e494152b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Volume volume-207d0c7b-8eef-4791-b79a-30ae3025af6d (207d0c7b-8eef-4791-b79a-30ae3025af6d): created successfully Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440d59c-e9e2-40ab-b144-10e494152b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Flow 'volume_create_manager' (82aab8b8-eb48-48e4-92f2-175e64b1a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-23ce38ca-63f6-42bc-9a01-a0fb917ab9bb tempest-VolumesListAdminTestJSON-1523939214 None] Created volume successfully. Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Flow 'volume_create_manager' (f23598f2-14cb-462a-8c71-c5cce97c18fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6c0d3c-b477-4790-8c1b-cd9608e40dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6c0d3c-b477-4790-8c1b-cd9608e40dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-796131679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d70e83-af67-4933-a80f-9651cdb9b622,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='45540d05280949599e7c57a949257447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:24Z,use_quota=True,user_id='7c0ccd9cd0584787bad110f9a4bb2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a949de4-b7f2-45fa-b30f-caca8cfa91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a949de4-b7f2-45fa-b30f-caca8cfa91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0855f9bd-d8ee-4b70-ad07-57fb7adfa375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0855f9bd-d8ee-4b70-ad07-57fb7adfa375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d70e83-af67-4933-a80f-9651cdb9b622', 'volume_name': 'volume-40d70e83-af67-4933-a80f-9651cdb9b622', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bef2e7-970f-425a-bd09-8d25487d1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bef2e7-970f-425a-bd09-8d25487d1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5373a53-afc9-4447-b4da-e396caf3b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Volume 40d70e83-af67-4933-a80f-9651cdb9b622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d70e83-af67-4933-a80f-9651cdb9b622', 'volume_size': 1} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-796131679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d70e83-af67-4933-a80f-9651cdb9b622,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='45540d05280949599e7c57a949257447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:24Z,use_quota=True,user_id='7c0ccd9cd0584787bad110f9a4bb2e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Creating volume 40d70e83-af67-4933-a80f-9651cdb9b622 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:24 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:24 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 1073741824 Sep 02 12:50:24 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Flow 'volume_create_manager' (45c52464-f505-4dda-ad37-7cf020d6f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9faba-03c9-4435-9f0c-f050dcddc503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9faba-03c9-4435-9f0c-f050dcddc503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e92ffc5-4c06-4d3e-a5eb-c3584a77806d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902768e347f743659db8c05ce1c80759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:25Z,use_quota=True,user_id='f3856eba7c654b2286a4948edbc5862b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29be8af-3ca8-457c-90dd-041f5b9a2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29be8af-3ca8-457c-90dd-041f5b9a2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a054b5-b8ce-45a6-bce9-ad070c0d2f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a054b5-b8ce-45a6-bce9-ad070c0d2f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e92ffc5-4c06-4d3e-a5eb-c3584a77806d', 'volume_name': 'volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baea9741-2d45-4944-9c21-45200de99ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baea9741-2d45-4944-9c21-45200de99ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64972241-bd20-4573-b333-a51e12489a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Volume 6e92ffc5-4c06-4d3e-a5eb-c3584a77806d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d', 'volume_size': 1} Sep 02 12:50:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:25 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 1073741824" returned: 0 in 0.647s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:25 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 Sep 02 12:50:25 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (b81e3b7a-0b3a-4a9b-ac07-d943372ff708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a3d72b-33ea-4d87-8603-21b6c2d09050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a3d72b-33ea-4d87-8603-21b6c2d09050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1448445769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811dc9ee-d723-4612-9f16-b6d5d8544e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:25Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7c1a09-0dfb-4d85-b007-587415123192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7c1a09-0dfb-4d85-b007-587415123192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dcea1f-2ec3-4e49-a2c2-18479ba22b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dcea1f-2ec3-4e49-a2c2-18479ba22b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811dc9ee-d723-4612-9f16-b6d5d8544e83', 'volume_name': 'volume-811dc9ee-d723-4612-9f16-b6d5d8544e83', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d84aba7-9a79-408d-bfbd-d9026d9b065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d84aba7-9a79-408d-bfbd-d9026d9b065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483fd85a-d762-4230-bb1e-9f685fbcf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Volume 811dc9ee-d723-4612-9f16-b6d5d8544e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811dc9ee-d723-4612-9f16-b6d5d8544e83', 'volume_size': 1} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:25 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e92ffc5-4c06-4d3e-a5eb-c3584a77806d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902768e347f743659db8c05ce1c80759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:25Z,use_quota=True,user_id='f3856eba7c654b2286a4948edbc5862b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Creating volume 6e92ffc5-4c06-4d3e-a5eb-c3584a77806d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:25 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:25 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d 1073741824 Sep 02 12:50:25 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5373a53-afc9-4447-b4da-e396caf3b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d70e83-af67-4933-a80f-9651cdb9b622', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1183769-36e9-4b75-b02e-70abedf854c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Volume volume-40d70e83-af67-4933-a80f-9651cdb9b622 (40d70e83-af67-4933-a80f-9651cdb9b622): created successfully Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1183769-36e9-4b75-b02e-70abedf854c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Flow 'volume_create_manager' (f23598f2-14cb-462a-8c71-c5cce97c18fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-aebbdb56-ff17-4752-8d16-6452d9233388 req-8c31c6bf-67a5-444d-96d9-84c2b98c837d tempest-VolumesGetTestJSON-927011972 None] Created volume successfully. Sep 02 12:50:26 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d 1073741824" returned: 0 in 0.520s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:26 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d Sep 02 12:50:26 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:26 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1448445769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811dc9ee-d723-4612-9f16-b6d5d8544e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:25Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Creating volume 811dc9ee-d723-4612-9f16-b6d5d8544e83 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64972241-bd20-4573-b333-a51e12489a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:26 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 1073741824 Sep 02 12:50:26 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d016c4-ad67-409f-be19-da9620046038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Volume volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d (6e92ffc5-4c06-4d3e-a5eb-c3584a77806d): created successfully Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d016c4-ad67-409f-be19-da9620046038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Flow 'volume_create_manager' (45c52464-f505-4dda-ad37-7cf020d6f242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-adecf677-a1bf-4aee-a5fd-8ba56145de32 tempest-VolumesListAdminTestJSON-2143522714 None] Created volume successfully. Sep 02 12:50:26 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 1073741824" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Acquiring lock "cinder-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "cinder-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:27 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 Sep 02 12:50:27 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Acquiring lock "cinder-quobyte-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "cinder-quobyte-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Acquiring lock "cinder-40d70e83-af67-4933-a80f-9651cdb9b622-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f687ff08-fbfe-444d-97f5-50c7349156e3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "cinder-40d70e83-af67-4933-a80f-9651cdb9b622-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-207d0c7b-8eef-4791-b79a-30ae3025af6d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Acquiring lock "cinder-quobyte-40d70e83-af67-4933-a80f-9651cdb9b622" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-207d0c7b-8eef-4791-b79a-30ae3025af6d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "cinder-quobyte-40d70e83-af67-4933-a80f-9651cdb9b622" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf5055-4dea-4694-9d66-6378a72fce20]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:27 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d Sep 02 12:50:27 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483fd85a-d762-4230-bb1e-9f685fbcf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811dc9ee-d723-4612-9f16-b6d5d8544e83', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bdea73-3fbb-49aa-b1d2-dc278473795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-quobyte-207d0c7b-8eef-4791-b79a-30ae3025af6d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Volume volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 (811dc9ee-d723-4612-9f16-b6d5d8544e83): created successfully Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bdea73-3fbb-49aa-b1d2-dc278473795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (b81e3b7a-0b3a-4a9b-ac07-d943372ff708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-207d0c7b-8eef-4791-b79a-30ae3025af6d" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7a7869e4-617d-4211-8db8-159ef53368a3 tempest-AttachVolumeNegativeTest-1587220222 None] Created volume successfully. Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78ec21-ddea-4343-8dba-6d08187235d8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:27 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 Sep 02 12:50:27 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:27 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d Sep 02 12:50:27 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:27 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" returned: 0 in 0.581s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:27 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d Sep 02 12:50:27 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:27 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:28 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:28 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622 Sep 02 12:50:28 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:28 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d Sep 02 12:50:28 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:28 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "cinder-quobyte-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d" released by "delete_volume" :: held 1.016s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Created reservations ['74458912-0f38-42e9-9e58-5ea4a4da18c5', '4dbf9877-e9a0-4349-932f-8d7ea1538438', '1193e4be-9a49-47ef-9471-ffe8f01f0595', '0d291fa4-5ee7-4d95-90ef-fc0b88db1040'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:28 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-40d70e83-af67-4933-a80f-9651cdb9b622" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "cinder-quobyte-40d70e83-af67-4933-a80f-9651cdb9b622" released by "delete_volume" :: held 0.957s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:28 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-207d0c7b-8eef-4791-b79a-30ae3025af6d" returned: 0 in 0.327s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-207d0c7b-8eef-4791-b79a-30ae3025af6d" released by "delete_volume" :: held 0.863s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:28 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:28 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.quota [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Created reservations ['5a2283aa-39d5-46fe-9262-432e4730edc5', 'df93a2b7-85c3-4656-9c4b-be1be75f487e', '5e9a953e-3205-4350-bae0-060d342b9838', 'ab50d76f-aaac-4905-ac58-bdba18d2e5af'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Created reservations ['8e1ee1fd-09cc-477f-9e73-65f609bd0f72', '6d4f95c1-204d-45a0-bf01-c411d1321c75', '269c145d-bca7-434d-bd2e-a64cfdefef51', 'df583010-d4d7-47f5-8f13-ba3ba0a065ab'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:28 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:28 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:28 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:28 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:28 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.manager [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.611s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Deleted volume successfully. Sep 02 12:50:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-quobyte-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-d076ab5b-e9fa-484e-b768-9baf0aa8c1b3 req-49ce49ec-ea36-47f6-baa7-ad7f20d7e793 tempest-VolumesGetTestJSON-927011972 None] Lock "cinder-40d70e83-af67-4933-a80f-9651cdb9b622-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" acquired by "delete_volume" :: waited 0.058s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Deleted volume successfully. Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c53173-1fce-4acd-9e21-3a742760704f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43f54cd5-b6db-4752-b12e-4c0afe753589 tempest-VolumesListAdminTestJSON-2143522714 None] Lock "cinder-6e92ffc5-4c06-4d3e-a5eb-c3584a77806d-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:29 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.512s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Deleted volume successfully. Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-11348431-b008-4aec-97e9-da69b9915617 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-207d0c7b-8eef-4791-b79a-30ae3025af6d-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:29 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 Sep 02 12:50:29 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:29 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:29 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2 Sep 02 12:50:29 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:29 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2" released by "delete_volume" :: held 0.905s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Created reservations ['47f9de64-941f-4675-a755-cfd4f9def76f', 'ae56c46a-2fda-4c1f-adad-b338a7e2bc89', 'a2c73e0e-b301-4b09-8ea3-b8df178aaf09', '9eee9dbb-1547-4d41-b170-f142958abc55'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8f1cd5bc-2a20-436b-ba87-b896aaf2024f req-37287c6c-cb9a-42f8-9100-eab03649b2a3 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8f1cd5bc-2a20-436b-ba87-b896aaf2024f req-37287c6c-cb9a-42f8-9100-eab03649b2a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8f1cd5bc-2a20-436b-ba87-b896aaf2024f req-37287c6c-cb9a-42f8-9100-eab03649b2a3 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-8f1cd5bc-2a20-436b-ba87-b896aaf2024f req-37287c6c-cb9a-42f8-9100-eab03649b2a3 tempest-AttachVolumeNegativeTest-1587220222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-811dc9ee-d723-4612-9f16-b6d5d8544e83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '388ce6cd-1a06-4c9d-a791-6671f043e1a8', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:30 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:30 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-8f1cd5bc-2a20-436b-ba87-b896aaf2024f req-37287c6c-cb9a-42f8-9100-eab03649b2a3 tempest-AttachVolumeNegativeTest-1587220222 None] attachment_update completed successfully. Sep 02 12:50:30 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Deleted volume successfully. Sep 02 12:50:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5dbe57c8-5455-48a9-a39d-5a3557ab9fdb tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-3b81b88c-7cd1-4d50-aeb5-c8b6fd4f47a2-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-4fef6278-e902-4d50-a718-bb7d22b12aea-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-4fef6278-e902-4d50-a718-bb7d22b12aea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "cinder-quobyte-4fef6278-e902-4d50-a718-bb7d22b12aea" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-4fef6278-e902-4d50-a718-bb7d22b12aea" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95b7a9-7434-4495-a3a1-d3797092b306]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:31 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea Sep 02 12:50:31 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:31 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:32 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea Sep 02 12:50:32 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:32 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4fef6278-e902-4d50-a718-bb7d22b12aea" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-quobyte-4fef6278-e902-4d50-a718-bb7d22b12aea" released by "delete_volume" :: held 0.813s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Created reservations ['e8a0370c-26c7-445c-b2b5-37630fd780ea', '50c2ac8d-3a00-4606-82c8-322027f9eef3', 'bfd24cf1-c99d-40b7-8d08-4db697a91305', '04a952b7-3f9a-4365-8181-ce3fb88ba33f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:32 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:32 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:32 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Deleted volume successfully. Sep 02 12:50:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f2993b70-ecfc-4a74-99ac-147902594931 tempest-VolumesListAdminTestJSON-1523939214 None] Lock "cinder-4fef6278-e902-4d50-a718-bb7d22b12aea-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b90f1c69-bd72-4d18-ac54-e00dd1d69b7e tempest-GroupSnapshotsV319Test-978528938 None] Group tempest-GroupSnapshotsV319Test-Group-1092481809: creating Sep 02 12:50:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b90f1c69-bd72-4d18-ac54-e00dd1d69b7e tempest-GroupSnapshotsV319Test-978528938 None] Group tempest-GroupSnapshotsV319Test-Group-1092481809: created successfully Sep 02 12:50:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b90f1c69-bd72-4d18-ac54-e00dd1d69b7e tempest-GroupSnapshotsV319Test-978528938 None] Create group completed successfully. Sep 02 12:50:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3b01291f-272c-4822-9ea6-c38a5768df39 tempest-GroupsV314Test-1792659902 None] Group tempest-GroupsV314Test-Group-873412538: creating Sep 02 12:50:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3b01291f-272c-4822-9ea6-c38a5768df39 tempest-GroupsV314Test-1792659902 None] Group tempest-GroupsV314Test-Group-873412538: created successfully Sep 02 12:50:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3b01291f-272c-4822-9ea6-c38a5768df39 tempest-GroupsV314Test-1792659902 None] Create group completed successfully. Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Flow 'volume_create_manager' (cc9a5eac-c5e0-4773-a022-30e0bfa4288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a88460-2ca5-4989-8125-355a0cc8fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a88460-2ca5-4989-8125-355a0cc8fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557589630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0154a52f-7847-4240-a52e-9d245ab174e8,host='devstack@QuobyteHD#QuobyteHD',id=06fdf69b-f4b0-4f69-92f6-cf939ff2154a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420af99486049519fca3c1afc925e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:37Z,use_quota=True,user_id='339b9492ffd9499bbbe5d1873d0ea2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7083a2d9-5eb0-45ff-8227-7947668e0dca),volume_type_id=7083a2d9-5eb0-45ff-8227-7947668e0dca)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7318820d-2a9f-4a0c-96ac-35f1bdd2222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7318820d-2a9f-4a0c-96ac-35f1bdd2222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725c1ca4-1041-4e09-8f1b-20ab8a1b2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725c1ca4-1041-4e09-8f1b-20ab8a1b2def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fdf69b-f4b0-4f69-92f6-cf939ff2154a', 'volume_name': 'volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18056d2f-876d-4bda-8fb5-84bafd3a85be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18056d2f-876d-4bda-8fb5-84bafd3a85be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d9624d-c3f5-433f-be6e-33ebed791371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Volume 06fdf69b-f4b0-4f69-92f6-cf939ff2154a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a', 'volume_size': 1} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0154a52f-7847-4240-a52e-9d245ab174e8,created_at=2026-09-02T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557589630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0154a52f-7847-4240-a52e-9d245ab174e8,host='devstack@QuobyteHD#QuobyteHD',id=06fdf69b-f4b0-4f69-92f6-cf939ff2154a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420af99486049519fca3c1afc925e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:37Z,use_quota=True,user_id='339b9492ffd9499bbbe5d1873d0ea2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7083a2d9-5eb0-45ff-8227-7947668e0dca),volume_type_id=7083a2d9-5eb0-45ff-8227-7947668e0dca)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Creating volume 06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:36 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:37 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a 1073741824 Sep 02 12:50:37 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:37 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:37 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:37 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a 1073741824" returned: 0 in 0.736s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:37 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:50:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:50:37 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a Sep 02 12:50:37 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Flow 'volume_create_manager' (9cf0d0d3-be7b-4732-b386-3e67cdb97f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9851cd-b6b1-4a38-badf-a72470e19c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9851cd-b6b1-4a38-badf-a72470e19c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121759787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=405a048e-92f6-4ca2-99c6-ac75a04f3ba1,host='devstack@QuobyteHD#QuobyteHD',id=10a9ba67-ebaf-4630-bfe9-1f5769887bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f5a56c308994318bb68b029e5cf21cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:38Z,use_quota=True,user_id='dacdcbd4df28462cb2102165fd7dc997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(840ad372-e8b7-45be-b429-2b0089491760),volume_type_id=840ad372-e8b7-45be-b429-2b0089491760)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499297dc-f383-4006-a7fd-407879a17c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499297dc-f383-4006-a7fd-407879a17c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f88b7-8a87-429d-ae6a-d449de4c101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f88b7-8a87-429d-ae6a-d449de4c101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a9ba67-ebaf-4630-bfe9-1f5769887bef', 'volume_name': 'volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebe75fa-282c-4a49-9e67-f365f90dca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebe75fa-282c-4a49-9e67-f365f90dca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bb6cd7-537c-4875-ab0a-e74e2c3628f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Volume 10a9ba67-ebaf-4630-bfe9-1f5769887bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef', 'volume_size': 1} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" returned: 0 in 0.840s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=405a048e-92f6-4ca2-99c6-ac75a04f3ba1,created_at=2026-09-02T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121759787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=405a048e-92f6-4ca2-99c6-ac75a04f3ba1,host='devstack@QuobyteHD#QuobyteHD',id=10a9ba67-ebaf-4630-bfe9-1f5769887bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f5a56c308994318bb68b029e5cf21cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:38Z,use_quota=True,user_id='dacdcbd4df28462cb2102165fd7dc997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(840ad372-e8b7-45be-b429-2b0089491760),volume_type_id=840ad372-e8b7-45be-b429-2b0089491760)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Creating volume 10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:38 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef 1073741824 Sep 02 12:50:38 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d9624d-c3f5-433f-be6e-33ebed791371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36f0612-19b2-4ea5-88ff-f9bff9a7399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Volume volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a (06fdf69b-f4b0-4f69-92f6-cf939ff2154a): created successfully Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36f0612-19b2-4ea5-88ff-f9bff9a7399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Flow 'volume_create_manager' (cc9a5eac-c5e0-4773-a022-30e0bfa4288f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-54f85752-bb6d-4848-b443-26cbb7c9571c tempest-GroupSnapshotsV319Test-978528938 None] Created volume successfully. Sep 02 12:50:39 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef 1073741824" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:39 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:39 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:39 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bb6cd7-537c-4875-ab0a-e74e2c3628f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b8752-3c0b-40ba-b48a-e71f76e8b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Volume volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef (10a9ba67-ebaf-4630-bfe9-1f5769887bef): created successfully Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b8752-3c0b-40ba-b48a-e71f76e8b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Flow 'volume_create_manager' (9cf0d0d3-be7b-4732-b386-3e67cdb97f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5269f266-1aa7-44b9-834f-b3cc33a45e23 tempest-GroupsV314Test-1792659902 None] Created volume successfully. Sep 02 12:50:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] GroupSnapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: creating. Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Group snapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Creating offline snapshot 584f7fad-b2df-4661-8f8a-8d12248d3f12 of volume 06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b4edd-77d1-4133-8f17-f9d36faa050f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:40 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a Sep 02 12:50:40 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:40 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" returned: 0 in 0.706s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:40 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 1G Sep 02 12:50:40 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:41 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 1G" returned: 0 in 0.744s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:41 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 Sep 02 12:50:41 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:42 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12" returned: 0 in 0.641s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:42 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 Sep 02 12:50:42 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:42 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:42 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info Sep 02 12:50:42 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:42 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:50:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:42 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info Sep 02 12:50:42 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:43 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.info" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.346s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Cloning volume 10a9ba67-ebaf-4630-bfe9-1f5769887bef to volume c472f0bc-3a85-4811-ba6e-be7090ca9f9b Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Creating offline snapshot e05db7f4-1805-42c0-a02e-50133c6feae4 of volume 10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3dc2d9-1cb7-4b94-a9fa-4e3628c2d1db]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6363610c-09af-46f7-9aae-ab97187861a7 tempest-GroupSnapshotsV319Test-978528938 None] group_snapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: created successfully Sep 02 12:50:43 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:43 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:43 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.565s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:43 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 1G Sep 02 12:50:43 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Flow 'volume_create_manager' (477ec743-d7f0-4bab-bbad-d8d7bd2a1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a247d0-ae66-416f-b047-2ef704e79d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a247d0-ae66-416f-b047-2ef704e79d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-485643673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415227ff-cc2f-44fe-96c4-bd3ca7072f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89261ce1d68b44c2bcf23dfcfc4b72a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:44Z,use_quota=True,user_id='cc3805f2f09a48ad9e69596245ba63c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a39492-7642-4de8-9424-44b8ce6ea46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a39492-7642-4de8-9424-44b8ce6ea46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dbb58d-6e7b-4d60-83be-2aab7ceb697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dbb58d-6e7b-4d60-83be-2aab7ceb697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '415227ff-cc2f-44fe-96c4-bd3ca7072f61', 'volume_name': 'volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a53d1a1-62b2-4384-84ae-dcef267ce8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a53d1a1-62b2-4384-84ae-dcef267ce8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591abccc-855f-4e6e-9b67-7d3149f7b393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Trying to clone 415227ff-cc2f-44fe-96c4-bd3ca7072f61 from image 522e45ed-34d8-4082-932f-8d27db1e62a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:50:44 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 1G" returned: 0 in 0.648s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:44 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:44 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] group_snapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: deleting Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] group_snapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 12:50:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "cinder-quobyte-584f7fad-b2df-4661-8f8a-8d12248d3f12" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-584f7fad-b2df-4661-8f8a-8d12248d3f12" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Deleting offline snapshot 584f7fad-b2df-4661-8f8a-8d12248d3f12 of volume 06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] snapshot_file for this snap is: volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[579eb76a-75b5-4c86-9605-f831a6f1edaa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:45 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.814s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:45 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:45 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:45 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 Sep 02 12:50:45 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:50:45 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Image download 20.69 MB at 20.69 MB/s Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221f24f-5c22-41a3-b3c1-7f8be22ca380]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:45 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:45 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD Sep 02 12:50:45 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:45 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info Sep 02 12:50:45 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:45 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12" returned: 0 in 0.770s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:45 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 is fetched for user cc3805f2f09a48ad9e69596245ba63c8. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652a93b-c1ed-4ece-aa44-0e5056d728ab]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=115,cinder:UPDATE=137,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:50:46 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:46 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:46 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info Sep 02 12:50:46 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac3d26-609f-4a2c-b5be-733363bad17f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:46 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a Sep 02 12:50:46 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:46 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD Sep 02 12:50:46 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:46 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.info" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Acquiring lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] snapshot: e05db7f4-1805-42c0-a02e-50133c6feae4, volume: c472f0bc-3a85-4811-ba6e-be7090ca9f9b, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:50:46 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" returned: 0 in 0.696s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2466fdc-a69b-430b-9505-a060cae7429f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:46 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:46 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 Sep 02 12:50:46 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:46 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:46 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:47 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12" returned: 0 in 0.463s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:47 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12 Sep 02 12:50:47 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:47 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b42b0-ac01-4b31-9b2e-fc3b7610a84b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:47 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:47 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:47 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a.584f7fad-b2df-4661-8f8a-8d12248d3f12" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-584f7fad-b2df-4661-8f8a-8d12248d3f12" released by "_delete_snapshot" :: held 2.617s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" released by "delete_snapshot" :: held 2.703s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:47 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:47 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b Sep 02 12:50:47 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:47 devstack cinder-volume[87092]: WARNING cinder.quota [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974860000 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974860000, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:47 devstack cinder-volume[87092]: WARNING cinder.quota [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-974860000 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-974860000, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] Created reservations ['8c46cdac-4312-42c2-9989-0f15fe5c0f06', '309db158-022c-4c7e-bb79-6d6ce9509855', '0f49bdf2-8391-4f6d-80bf-31e605adf28c', 'e94c76db-24fa-484b-a9ea-def1de8492f3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-95fb1ef5-1b23-4022-87fc-2df698efecd3 tempest-GroupSnapshotsV319Test-978528938 None] group_snapshot eabdcbf4-d6a5-4522-9744-7c14de99bc17: deleted successfully Sep 02 12:50:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a50b1-4c1c-40fc-b628-798ed543c9d5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:50 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a Sep 02 12:50:50 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:51 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" returned: 0 in 1.214s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:51 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a Sep 02 12:50:51 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:51 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" returned: 0 in 0.746s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Lock "cinder-quobyte-06fdf69b-f4b0-4f69-92f6-cf939ff2154a" released by "delete_volume" :: held 2.142s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Created reservations ['7785ee0b-0b8f-4858-b6b0-32c9707fe1c1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:52 devstack cinder-volume[87092]: WARNING cinder.quota [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-974860000 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-974860000, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Created reservations ['ad904f18-861c-4e96-b8b3-0616d38446bd', '6b1451a2-82cf-4938-8d84-a85b66b372b5', '7ca636c5-2428-481b-be24-eea7bb909d20', '7342fcd6-a019-401b-82c2-ff65cb551b05'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:52 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:52 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:53 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.692s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2d3bcd8d-5f3e-4477-aed1-600eb3214fe5 tempest-GroupSnapshotsV319Test-978528938 None] Delete group completed successfully. Sep 02 12:50:54 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" returned: 0 in 6.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:50:54 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Converted 1024.00 MB image at 158.15 MB/s Sep 02 12:50:54 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b is being set with open permissions: ugo+rw: NotImplementedError Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:54 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b Sep 02 12:50:54 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:54 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" returned: 0 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" released by "_copy_volume_from_snapshot" :: held 7.886s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Acquiring lock "cinder-quobyte-e05db7f4-1805-42c0-a02e-50133c6feae4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-e05db7f4-1805-42c0-a02e-50133c6feae4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Deleting offline snapshot e05db7f4-1805-42c0-a02e-50133c6feae4 of volume 10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] snapshot_file for this snap is: volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4998171-bda2-40cc-af22-b9fc5aa39fb8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:54 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:54 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:55 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddad0fa7-c5c6-402d-9a4f-30a05b42631b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:55 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:55 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:55 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.584s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:55 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:55 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:56 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:56 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4 Sep 02 12:50:56 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:56 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef.e05db7f4-1805-42c0-a02e-50133c6feae4" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-e05db7f4-1805-42c0-a02e-50133c6feae4" released by "_delete_snapshot" :: held 1.885s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.343s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.688s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-485643673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415227ff-cc2f-44fe-96c4-bd3ca7072f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89261ce1d68b44c2bcf23dfcfc4b72a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:50:44Z,use_quota=True,user_id='cc3805f2f09a48ad9e69596245ba63c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Creating volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:56 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1073741824 Sep 02 12:50:56 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-df82d86c-5244-44a5-af48-3aab9d90e44b tempest-GroupsV314Test-1792659902 None] Create group from source-group-405a048e-92f6-4ca2-99c6-ac75a04f3ba1 completed successfully. Sep 02 12:50:57 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1073741824" returned: 0 in 0.507s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:57 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 Sep 02 12:50:57 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:57 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Attempting download of 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Acquiring lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7119dc52-9f8b-4836-a15b-8fa0c20abd1c]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed87c15-35cf-4346-a713-4b36e9d2ef37]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:57 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci Sep 02 12:50:57 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:57 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b Sep 02 12:50:57 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:57 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:57 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:57 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci Sep 02 12:50:57 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:57 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b Sep 02 12:50:57 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:58 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci" returned: 1 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_pqjjk_ci' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[898ad577-a412-4183-85ea-548e7b7a55de]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:58 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-c472f0bc-3a85-4811-ba6e-be7090ca9f9b" released by "delete_volume" :: held 0.739s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Created reservations ['698e8398-8ff7-4665-8dd9-c161249db65e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:58 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD Sep 02 12:50:58 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:58 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1988900721 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1988900721, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:58 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1988900721 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1988900721, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Created reservations ['15d229c4-4c35-4aa5-bdf1-6eaf974b3e83', '745d45b9-71a9-4e9a-b6b6-32a78623645c', '319b30eb-5d43-4c8a-af0f-ffdf6d2402c4', 'a0f960bf-0dc3-4788-825a-58f92f3299f9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:58 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] 522e45ed-34d8-4082-932f-8d27db1e62a2 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:58 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:50:58 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:58 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 Sep 02 12:50:58 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:58 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:50:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a05ba638-cd18-4c3a-a4a4-a999577ce563 tempest-GroupsV314Test-1792659902 None] Delete group completed successfully. Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Acquiring lock "cinder-quobyte-10a9ba67-ebaf-4630-bfe9-1f5769887bef" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-10a9ba67-ebaf-4630-bfe9-1f5769887bef" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7749793-b7b1-4f5b-8ab6-0c72de1f4910]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:59 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:59 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:59 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:59 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef Sep 02 12:50:59 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Flow 'volume_create_manager' (773cbd29-fcab-41b8-9173-884d090438f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b23026f-dbe4-4883-b1cd-2ef8893b9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b23026f-dbe4-4883-b1cd-2ef8893b9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1744200202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e6751b-d6f6-4ecd-bed6-ce431525b645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47436efb836440fae25d31a446f794e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:00Z,use_quota=True,user_id='e47eb13ee6ba4f47a83faff7f792c6fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1ceaf-e3e3-4b58-bebf-a5a253c73119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1ceaf-e3e3-4b58-bebf-a5a253c73119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f6927f-e050-4141-b58d-9e0571de1b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f6927f-e050-4141-b58d-9e0571de1b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e6751b-d6f6-4ecd-bed6-ce431525b645', 'volume_name': 'volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda53174-5c80-45ce-8634-66d1af71695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda53174-5c80-45ce-8634-66d1af71695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2136648-a4bc-4b6b-8dbb-2116b068f57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:50:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Volume f6e6751b-d6f6-4ecd-bed6-ce431525b645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645', 'volume_size': 1} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1744200202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e6751b-d6f6-4ecd-bed6-ce431525b645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47436efb836440fae25d31a446f794e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:00Z,use_quota=True,user_id='e47eb13ee6ba4f47a83faff7f792c6fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Creating volume f6e6751b-d6f6-4ecd-bed6-ce431525b645 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:50:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:50:59 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 1073741824 Sep 02 12:50:59 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:50:59 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-10a9ba67-ebaf-4630-bfe9-1f5769887bef" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:50:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Lock "cinder-quobyte-10a9ba67-ebaf-4630-bfe9-1f5769887bef" released by "delete_volume" :: held 0.874s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Created reservations ['af022d6f-8000-40cf-b984-c524093c0451'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Created reservations ['4cbe07f7-8d8b-4885-854b-170535cf457c', 'c9ff5984-666a-4d8f-a47f-d8f79bd62dcf', '8660b183-dd73-4ea6-8442-066a6c831c81', '437b4ce7-db16-422c-b761-5701a92383e9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:00 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:00 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:00 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 1073741824" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:00 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 Sep 02 12:51:00 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:00 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c0f8843f-73f0-4f52-9801-425f5cf5af8e tempest-GroupsV314Test-1792659902 None] Delete group completed successfully. Sep 02 12:51:00 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61" returned: 0 in 2.055s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_7gk4k6pgdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:51:00 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Converted 112.00 MB image at 54.47 MB/s Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:00 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:00 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1G Sep 02 12:51:00 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2136648-a4bc-4b6b-8dbb-2116b068f57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6216b635-1fd6-4030-b4de-ff4239a317ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Volume volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 (f6e6751b-d6f6-4ecd-bed6-ce431525b645): created successfully Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6216b635-1fd6-4030-b4de-ff4239a317ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Flow 'volume_create_manager' (773cbd29-fcab-41b8-9173-884d090438f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b3915645-89ba-45b9-9c75-46337af06776 tempest-VolumesServicesTestJSON-57432821 None] Created volume successfully. Sep 02 12:51:00 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 1G" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Downloaded image 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 for user cc3805f2f09a48ad9e69596245ba63c8 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:51:00 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Marking volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Copying metadata from image 522e45ed-34d8-4082-932f-8d27db1e62a2 to 415227ff-cc2f-44fe-96c4-bd3ca7072f61. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Creating volume glance metadata for volume 415227ff-cc2f-44fe-96c4-bd3ca7072f61 backed by image 522e45ed-34d8-4082-932f-8d27db1e62a2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591abccc-855f-4e6e-9b67-7d3149f7b393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f140ef-721a-4f88-af2b-a94ef8210633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Volume volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 (415227ff-cc2f-44fe-96c4-bd3ca7072f61): created successfully Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f140ef-721a-4f88-af2b-a94ef8210633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Flow 'volume_create_manager' (477ec743-d7f0-4bab-bbad-d8d7bd2a1b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-97d12eff-8a8a-400d-a878-04a1d735028b tempest-VolumesImageMetadata-769175541 None] Created volume successfully. Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Acquiring lock "cinder-f6e6751b-d6f6-4ecd-bed6-ce431525b645-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "cinder-f6e6751b-d6f6-4ecd-bed6-ce431525b645-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Acquiring lock "cinder-quobyte-f6e6751b-d6f6-4ecd-bed6-ce431525b645" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "cinder-quobyte-f6e6751b-d6f6-4ecd-bed6-ce431525b645" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff3b2e1-8048-4705-be49-7d0c7831387b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:02 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 Sep 02 12:51:02 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:02 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645" returned: 0 in 0.538s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:02 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645 Sep 02 12:51:02 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Acquiring lock "cinder-415227ff-cc2f-44fe-96c4-bd3ca7072f61-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "cinder-415227ff-cc2f-44fe-96c4-bd3ca7072f61-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=154,cinder:DELETE=10,cinder:SELECT=146,cinder:INSERT=45 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Acquiring lock "cinder-quobyte-415227ff-cc2f-44fe-96c4-bd3ca7072f61" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "cinder-quobyte-415227ff-cc2f-44fe-96c4-bd3ca7072f61" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc4886-309c-46d2-829a-ed7f0342e113]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:03 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f6e6751b-d6f6-4ecd-bed6-ce431525b645" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:03 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 Sep 02 12:51:03 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "cinder-quobyte-f6e6751b-d6f6-4ecd-bed6-ce431525b645" released by "delete_volume" :: held 1.026s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Created reservations ['c1770c7e-a453-4831-b9b7-1a684071ad37', '4eaf70be-1400-4c4b-9bc0-942f5d827834', 'df9a5204-2c3e-4ae8-8975-de980977a3d8', 'a59e1f9d-56b1-4e3d-bb3a-92ab34a8aafd'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:03 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:03 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:03 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61" returned: 0 in 0.490s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:03 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61 Sep 02 12:51:03 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:03 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.312s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Deleted volume successfully. Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84ac6f87-f55d-47df-9915-4023649d8d94 tempest-VolumesServicesTestJSON-57432821 None] Lock "cinder-f6e6751b-d6f6-4ecd-bed6-ce431525b645-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:03 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-415227ff-cc2f-44fe-96c4-bd3ca7072f61" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "cinder-quobyte-415227ff-cc2f-44fe-96c4-bd3ca7072f61" released by "delete_volume" :: held 0.854s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Created reservations ['6a4ab9c6-f191-4720-bc43-fde869fd7bd7', 'f3b985cb-3a1b-4cb9-9273-4e66169a665f', '74ba2c7c-7427-4296-9fcd-6d55adefe1c2', 'fb9d8a96-efaf-474c-95f7-432e8072d307'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:03 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:03 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:04 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Deleted volume successfully. Sep 02 12:51:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27b4a257-8f58-4f0c-8b8f-ba697b7ad27a tempest-VolumesImageMetadata-769175541 None] Lock "cinder-415227ff-cc2f-44fe-96c4-bd3ca7072f61-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7b2fc55d-d899-4378-b8d5-32b5a9dd6e83 tempest-GroupsV320Test-1626455715 None] Group tempest-GroupsV320Test-Group-1990361888: creating Sep 02 12:51:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7b2fc55d-d899-4378-b8d5-32b5a9dd6e83 tempest-GroupsV320Test-1626455715 None] Group tempest-GroupsV320Test-Group-1990361888: created successfully Sep 02 12:51:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7b2fc55d-d899-4378-b8d5-32b5a9dd6e83 tempest-GroupsV320Test-1626455715 None] Create group completed successfully. Sep 02 12:51:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (9c79b21e-b166-4648-b823-27d011842fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e15233a-38c2-4fb3-b9bd-61a6313e5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e15233a-38c2-4fb3-b9bd-61a6313e5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-783573293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22c6895-6dba-4437-b1e6-a3af7c5c5361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f664acb65345f980e0a1d5f4048b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:08Z,use_quota=True,user_id='8aa5837efcfb491d832a7c823342f928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effc0e04-9aa6-403e-b88f-0ead2449ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effc0e04-9aa6-403e-b88f-0ead2449ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796f21d3-827d-445a-bead-0583c051ea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796f21d3-827d-445a-bead-0583c051ea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22c6895-6dba-4437-b1e6-a3af7c5c5361', 'volume_name': 'volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b784dca-e39a-4a0c-87b1-f36c3e09a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b784dca-e39a-4a0c-87b1-f36c3e09a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa376b6c-9d1d-4741-8ea8-97d852362dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Volume a22c6895-6dba-4437-b1e6-a3af7c5c5361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361', 'volume_size': 1} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-783573293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22c6895-6dba-4437-b1e6-a3af7c5c5361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f664acb65345f980e0a1d5f4048b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:08Z,use_quota=True,user_id='8aa5837efcfb491d832a7c823342f928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Creating volume a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:08 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 1073741824 Sep 02 12:51:08 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:08 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 1073741824" returned: 0 in 0.713s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:08 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 Sep 02 12:51:08 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Created reservations ['beb35684-9427-41a5-a086-4f929111494d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:09 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:09 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:09 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa376b6c-9d1d-4741-8ea8-97d852362dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79792fcb-11f2-42b2-8fc3-a5ea83aeb107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Volume volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 (a22c6895-6dba-4437-b1e6-a3af7c5c5361): created successfully Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79792fcb-11f2-42b2-8fc3-a5ea83aeb107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (9c79b21e-b166-4648-b823-27d011842fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5536813c-0847-476b-a35e-6c5f3456c992 tempest-VolumesDeleteCascade-854263208 None] Created volume successfully. Sep 02 12:51:09 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:09 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-69811dee-39eb-4b92-b31f-e4e7b82b6798 tempest-GroupsV320Test-1626455715 None] Delete group completed successfully. Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Creating offline snapshot d6b9ebbe-e359-4d98-919f-0defd37052bd of volume a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[80901e03-096c-4b42-aa92-2425e89ceb93]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:10 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 Sep 02 12:51:10 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:10 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361" returned: 0 in 0.512s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:10 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd 1G Sep 02 12:51:10 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:11 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd 1G" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:11 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:11 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:11 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd is being set with open permissions: ugo+rw Sep 02 12:51:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:11 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:11 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:12 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:12 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info Sep 02 12:51:12 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:12 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info is being set with open permissions: ugo+rw Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:12 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info Sep 02 12:51:12 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:12 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c1a02fb1-015b-4ee5-9415-2e40ac35c793 tempest-VolumesDeleteCascade-854263208 None] Create snapshot completed successfully Sep 02 12:51:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-353029f2-c3f0-4db7-b2c4-7a58174c45b4 req-6cfbe14d-8a34-4e63-b324-2644c11ae197 tempest-AttachVolumeNegativeTest-1587220222 None] Terminate volume connection completed successfully. Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-353029f2-c3f0-4db7-b2c4-7a58174c45b4 req-6cfbe14d-8a34-4e63-b324-2644c11ae197 tempest-AttachVolumeNegativeTest-1587220222 None] Deleting attachment 388ce6cd-1a06-4c9d-a791-6671f043e1a8. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Creating offline snapshot a284cbee-135b-41c8-8477-26267455c42d of volume a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24f4a0-d481-4c73-a178-c095117d6cbd]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:14 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:14 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:14 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:14 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d 1G Sep 02 12:51:14 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:15 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d 1G" returned: 0 in 0.733s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:15 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d Sep 02 12:51:15 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:15 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d is being set with open permissions: ugo+rw Sep 02 12:51:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:15 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d Sep 02 12:51:15 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:16 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ad10ca0f-5e73-4edd-baab-fa90fb3e49d7 tempest-VolumesDeleteCascade-854263208 None] Create snapshot completed successfully Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-a22c6895-6dba-4437-b1e6-a3af7c5c5361-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-a22c6895-6dba-4437-b1e6-a3af7c5c5361-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Performing cascade delete. {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-a284cbee-135b-41c8-8477-26267455c42d-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-a284cbee-135b-41c8-8477-26267455c42d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-a284cbee-135b-41c8-8477-26267455c42d" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a284cbee-135b-41c8-8477-26267455c42d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Deleting offline snapshot a284cbee-135b-41c8-8477-26267455c42d of volume a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] snapshot_file for this snap is: volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[130696c9-3fc6-4c83-b937-b60869de19c9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:17 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d Sep 02 12:51:17 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Flow 'volume_create_manager' (fd2a613e-ad4b-4dd6-a6d4-da9336e5b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2037b9bf-905c-4347-95b0-5ecab1b392f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2037b9bf-905c-4347-95b0-5ecab1b392f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-458906393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9611827e-5493-44b9-887d-0246450bf262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3befa76b006a439495d20f827ed66473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:18Z,use_quota=True,user_id='b5be0aecb0b44095ad0727589aa9cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d854d-f5c6-4171-a1b9-da3125876c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6d854d-f5c6-4171-a1b9-da3125876c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4929f5-b09b-434f-9b55-524355f95710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4929f5-b09b-434f-9b55-524355f95710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9611827e-5493-44b9-887d-0246450bf262', 'volume_name': 'volume-9611827e-5493-44b9-887d-0246450bf262', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c60bc8-d8e2-442d-9783-9e015a23968d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c60bc8-d8e2-442d-9783-9e015a23968d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6b3d5-1249-42a5-90f3-f6edb0804b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Volume 9611827e-5493-44b9-887d-0246450bf262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9611827e-5493-44b9-887d-0246450bf262', 'volume_size': 1} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-458906393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9611827e-5493-44b9-887d-0246450bf262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3befa76b006a439495d20f827ed66473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:18Z,use_quota=True,user_id='b5be0aecb0b44095ad0727589aa9cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Creating volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:17 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d" returned: 0 in 0.544s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:17 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 1073741824 Sep 02 12:51:17 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b981a57-ed53-487e-aaa9-d772b6752bd8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:18 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:18 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:18 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.612s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:18 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 1073741824" returned: 0 in 0.742s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:18 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d Sep 02 12:51:18 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:18 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 Sep 02 12:51:18 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:18 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6b3d5-1249-42a5-90f3-f6edb0804b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9611827e-5493-44b9-887d-0246450bf262', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a726ed-0eac-4dfc-a683-acd2e07619b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Volume volume-9611827e-5493-44b9-887d-0246450bf262 (9611827e-5493-44b9-887d-0246450bf262): created successfully Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a726ed-0eac-4dfc-a683-acd2e07619b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Flow 'volume_create_manager' (fd2a613e-ad4b-4dd6-a6d4-da9336e5b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fc60e806-1b99-449e-a858-9f7f03268102 tempest-SnapshotsActionsTest-615070369 None] Created volume successfully. Sep 02 12:51:19 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:19 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d Sep 02 12:51:19 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:19 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.a284cbee-135b-41c8-8477-26267455c42d" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a284cbee-135b-41c8-8477-26267455c42d" released by "_delete_snapshot" :: held 2.162s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" released by "delete_snapshot" :: held 2.199s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['9829111b-6eca-448e-a815-57af4a6761c7', 'f7c3c856-8fd1-464d-a3bd-70f1170e9253', '47fd711e-6eb9-46dd-b00b-b76cb3c26634', '1e1c9f1d-aa39-4d74-9979-ea4650a6a0c5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Delete snapshot completed successfully. Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-a284cbee-135b-41c8-8477-26267455c42d-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-d6b9ebbe-e359-4d98-919f-0defd37052bd-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-d6b9ebbe-e359-4d98-919f-0defd37052bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-d6b9ebbe-e359-4d98-919f-0defd37052bd" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-d6b9ebbe-e359-4d98-919f-0defd37052bd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Deleting offline snapshot d6b9ebbe-e359-4d98-919f-0defd37052bd of volume a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] snapshot_file for this snap is: volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ceda1-6759-41dd-bae5-1e7b4999f00a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:19 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:19 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:20 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Creating offline snapshot dcd0d655-da93-4829-a195-fb7685922b51 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[15417972-d940-4674-9f1b-a907c714efa7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b7703-e4f6-4430-adbe-238143841608]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:20 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 Sep 02 12:51:20 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:20 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 Sep 02 12:51:20 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:20 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:20 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:20 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:20 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262" returned: 0 in 0.516s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:20 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 1G Sep 02 12:51:20 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:21 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:21 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd Sep 02 12:51:21 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:21 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 1G" returned: 0 in 0.638s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:21 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:21 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:21 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361.d6b9ebbe-e359-4d98-919f-0defd37052bd" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-d6b9ebbe-e359-4d98-919f-0defd37052bd" released by "_delete_snapshot" :: held 1.972s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" released by "delete_snapshot" :: held 2.013s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['8458dc64-e614-485c-8ebb-e9726cbeea75', '7755a1c2-c4b1-4cc5-bd58-3dd831f46930', 'a4674203-d760-416c-b383-885492df4049', '6d27d7c5-6b65-4121-a387-e758810ce06b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Delete snapshot completed successfully. Sep 02 12:51:21 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:21 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 is being set with open permissions: ugo+rw Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-d6b9ebbe-e359-4d98-919f-0defd37052bd-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Snapshots deleted, issuing volume delete {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:21 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:21 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef6529-965b-4ea2-8eb2-da8378a1e956]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:22 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 Sep 02 12:51:22 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:22 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:22 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info Sep 02 12:51:22 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:22 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:22 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361 Sep 02 12:51:22 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:22 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:22 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info is being set with open permissions: ugo+rw Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:22 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info Sep 02 12:51:22 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:22 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a22c6895-6dba-4437-b1e6-a3af7c5c5361" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-a22c6895-6dba-4437-b1e6-a3af7c5c5361" released by "delete_volume" :: held 0.868s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['886bb7d5-c34e-4d4b-8ea8-d877fb7fe32e', '9e084b66-7e1c-43ca-a4ed-d4f527700a0e', '05b8d466-07ff-4977-8075-5b5888069d94', 'c7474204-2578-4e16-9cb3-6706954542de'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:22 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:22 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:22 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.info" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-655aa26a-13eb-4269-b1ca-5d791fc5b081 tempest-SnapshotsActionsTest-615070369 None] Create snapshot completed successfully Sep 02 12:51:23 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Deleted volume successfully. Sep 02 12:51:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fb192c8c-65d7-4a04-9b98-422e138a24f4 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-a22c6895-6dba-4437-b1e6-a3af7c5c5361-delete_volume" released by "delete_volume" :: held 6.148s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Creating offline snapshot fb7d0926-9270-4654-bc2e-c98b2dd4e883 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea794bf-4e91-4cca-b3d6-1ba90a02f482]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:24 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:24 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (05542b24-02f2-47a0-b434-beb4f71c1d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c432d8b-fae6-4e45-90cd-efbf5feabf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c432d8b-fae6-4e45-90cd-efbf5feabf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1477669054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c883d3ba-afd3-4be5-b9ea-8a44d44b577e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f664acb65345f980e0a1d5f4048b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:25Z,use_quota=True,user_id='8aa5837efcfb491d832a7c823342f928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9e8e43-c671-423f-b060-1029a344617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9e8e43-c671-423f-b060-1029a344617b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82f10ec-e8b9-4a4e-b9ad-2ded692972e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82f10ec-e8b9-4a4e-b9ad-2ded692972e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c883d3ba-afd3-4be5-b9ea-8a44d44b577e', 'volume_name': 'volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb997599-4032-49aa-9ab7-3957693a3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb997599-4032-49aa-9ab7-3957693a3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010fb4f-c441-4d8b-81ff-1fec31a3ef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Volume c883d3ba-afd3-4be5-b9ea-8a44d44b577e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e', 'volume_size': 1} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:24 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:24 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 1G Sep 02 12:51:24 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:25 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 1G" returned: 0 in 0.719s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:25 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 Sep 02 12:51:25 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:26 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883" returned: 0 in 0.435s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:26 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 is being set with open permissions: ugo+rw Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:26 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 Sep 02 12:51:26 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:26 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1477669054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c883d3ba-afd3-4be5-b9ea-8a44d44b577e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f664acb65345f980e0a1d5f4048b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:25Z,use_quota=True,user_id='8aa5837efcfb491d832a7c823342f928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Creating volume c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:51:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:26 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e 1073741824 Sep 02 12:51:26 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eb536cd4-6a13-48a5-9303-6b5219ef18d4 tempest-SnapshotsActionsTest-615070369 None] Create snapshot completed successfully Sep 02 12:51:27 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e 1073741824" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:27 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:27 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:27 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7010fb4f-c441-4d8b-81ff-1fec31a3ef44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a57ab28-624e-4271-8962-5c8cc5d738c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-fb7d0926-9270-4654-bc2e-c98b2dd4e883-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Volume volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e (c883d3ba-afd3-4be5-b9ea-8a44d44b577e): created successfully Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a57ab28-624e-4271-8962-5c8cc5d738c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (05542b24-02f2-47a0-b434-beb4f71c1d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-fb7d0926-9270-4654-bc2e-c98b2dd4e883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e3b365ea-69ce-4ad8-afca-8f51ef5e7bff tempest-VolumesDeleteCascade-854263208 None] Created volume successfully. Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-fb7d0926-9270-4654-bc2e-c98b2dd4e883" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-fb7d0926-9270-4654-bc2e-c98b2dd4e883" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Deleting offline snapshot fb7d0926-9270-4654-bc2e-c98b2dd4e883 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] snapshot_file for this snap is: volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaf574-2e94-462d-a889-6ea3b61b9257]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:28 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 Sep 02 12:51:28 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:28 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da90105-dec3-4740-9520-67b146a9df98]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:28 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:28 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:28 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.442s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:28 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 Sep 02 12:51:28 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Creating offline snapshot 745d147d-ec87-4026-a71d-d6b2f0c6a395 of volume c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f493c4e-8625-4bf2-a746-031d2c7744c5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:29 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:29 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883 Sep 02 12:51:29 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:29 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:29 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:29 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.fb7d0926-9270-4654-bc2e-c98b2dd4e883" returned: 0 in 0.556s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-fb7d0926-9270-4654-bc2e-c98b2dd4e883" released by "_delete_snapshot" :: held 2.151s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_snapshot" :: held 2.182s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:30 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.657s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:30 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 1G Sep 02 12:51:30 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Created reservations ['6d9e8d9e-24e9-4cc0-adf5-9af4e6027ec4', '84fdccb8-a57d-42de-b68f-eeca1849190a', '2dd9f957-2b8a-43a1-9f18-a005bf7bc317', 'ab469c4d-ba8f-47b2-8f2a-975e87d7b6ba'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Delete snapshot completed successfully. Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96b58897-de8a-48ea-949a-6d0d88ae729d tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-fb7d0926-9270-4654-bc2e-c98b2dd4e883-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:30 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 1G" returned: 0 in 0.838s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:30 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:30 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:31 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.652s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 is being set with open permissions: ugo+rw Sep 02 12:51:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:31 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:31 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:32 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.573s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:32 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info Sep 02 12:51:32 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:32 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info is being set with open permissions: ugo+rw Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:32 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info Sep 02 12:51:32 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:32 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.info" returned: 0 in 0.443s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Creating offline snapshot eb9dbf29-6eab-4d69-8b15-932138b675bb of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-99ba5387-001d-41e4-9a15-e6de629d1e0a tempest-VolumesDeleteCascade-854263208 None] Create snapshot completed successfully Sep 02 12:51:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[80359abd-8be8-488c-9418-96caef0152a1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:33 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:33 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:33 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.601s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:33 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb 1G Sep 02 12:51:33 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:34 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb 1G" returned: 0 in 0.780s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:34 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb Sep 02 12:51:34 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (0d17c4e0-5158-476f-93ef-d9971ac37816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13075c0a-2ea4-4222-9dae-3a6bdcfec8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13075c0a-2ea4-4222-9dae-3a6bdcfec8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1468242928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6932be85-9313-4d52-8b63-332245182ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f664acb65345f980e0a1d5f4048b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=745d147d-ec87-4026-a71d-d6b2f0c6a395,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:35Z,use_quota=True,user_id='8aa5837efcfb491d832a7c823342f928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b2aa16-7ccc-444e-902a-2190eddcfb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b2aa16-7ccc-444e-902a-2190eddcfb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380d048e-a6ad-41b8-8343-31eb90b33d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380d048e-a6ad-41b8-8343-31eb90b33d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6932be85-9313-4d52-8b63-332245182ca3', 'volume_name': 'volume-6932be85-9313-4d52-8b63-332245182ca3', 'volume_size': 1, 'snapshot_id': '745d147d-ec87-4026-a71d-d6b2f0c6a395'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f6aab-cca0-4fd9-9554-b8533f9da177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31f6aab-cca0-4fd9-9554-b8533f9da177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf02907-b193-4ea9-8830-8c056a439963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Volume 6932be85-9313-4d52-8b63-332245182ca3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6932be85-9313-4d52-8b63-332245182ca3', 'volume_size': 1, 'snapshot_id': '745d147d-ec87-4026-a71d-d6b2f0c6a395'} Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:34 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb" returned: 0 in 0.542s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:34 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb is being set with open permissions: ugo+rw Sep 02 12:51:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:35 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb Sep 02 12:51:35 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:35 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.521s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395-6932be85-9313-4d52-8b63-332245182ca3" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395-6932be85-9313-4d52-8b63-332245182ca3" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Creating volume 6932be85-9313-4d52-8b63-332245182ca3 from snapshot 745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-de71369e-7a44-4d95-9b88-5577fe72f053 tempest-SnapshotsActionsTest-615070369 None] Create snapshot completed successfully Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] snapshot: 745d147d-ec87-4026-a71d-d6b2f0c6a395, volume: 6932be85-9313-4d52-8b63-332245182ca3, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b651ab5-2e37-40c1-958c-a52eaba04a6a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:35 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:35 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:36 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274b45a-1180-4e3a-92bd-0c9f9e6667d9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:36 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:36 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-eb9dbf29-6eab-4d69-8b15-932138b675bb-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-eb9dbf29-6eab-4d69-8b15-932138b675bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-eb9dbf29-6eab-4d69-8b15-932138b675bb" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-eb9dbf29-6eab-4d69-8b15-932138b675bb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Deleting offline snapshot eb9dbf29-6eab-4d69-8b15-932138b675bb of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] snapshot_file for this snap is: volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6966a5-1682-4c37-a7b6-51fd312f748c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:36 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:51:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:36 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb Sep 02 12:51:36 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:36 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 Sep 02 12:51:36 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:37 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da8689-938e-47a5-b10e-75ac3585f58f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:37 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:37 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:37 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:37 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:38 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 1.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:38 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 1.031s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:51:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:51:38 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb Sep 02 12:51:38 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:39 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb" returned: 0 in 1.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:40 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb Sep 02 12:51:40 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:40 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.eb9dbf29-6eab-4d69-8b15-932138b675bb" returned: 0 in 1.028s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-eb9dbf29-6eab-4d69-8b15-932138b675bb" released by "_delete_snapshot" :: held 4.522s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_snapshot" :: held 4.573s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Created reservations ['d9c9cd4a-2f0a-4f8d-897f-a289c1b06b0d', 'fd2f29f9-28bf-4501-bf7f-c889f5d7bcc0', 'cf68aa07-5236-4532-9b44-35dfeadcbb53', '3cb020ab-22b1-41f5-95de-604962839552'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Delete snapshot completed successfully. Sep 02 12:51:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f173904e-91ce-46d9-9309-f0063dac74f1 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-eb9dbf29-6eab-4d69-8b15-932138b675bb-delete_snapshot" released by "delete_snapshot" :: held 5.192s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:43 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3" returned: 0 in 7.022s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:51:43 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Converted 1024.00 MB image at 145.80 MB/s Sep 02 12:51:43 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 is being set with open permissions: ugo+rw Sep 02 12:51:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:43 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 Sep 02 12:51:43 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:44 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" released by "_copy_volume_from_snapshot" :: held 8.505s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395-6932be85-9313-4d52-8b63-332245182ca3" released by "_create_volume_from_snapshot" :: held 8.607s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.654s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Creating offline snapshot df233a51-03a1-4e68-9a17-029c9448ee59 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf02907-b193-4ea9-8830-8c056a439963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6932be85-9313-4d52-8b63-332245182ca3', 'volume_size': 1, 'snapshot_id': '745d147d-ec87-4026-a71d-d6b2f0c6a395'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1b011-0649-4424-8913-0806b217fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce9b2a-277c-40f2-a1d1-f947c2abb18e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Volume volume-6932be85-9313-4d52-8b63-332245182ca3 (6932be85-9313-4d52-8b63-332245182ca3): created successfully Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1b011-0649-4424-8913-0806b217fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Flow 'volume_create_manager' (0d17c4e0-5158-476f-93ef-d9971ac37816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f10f2a7a-8e43-4e09-bee9-eade457151a3 tempest-VolumesDeleteCascade-854263208 None] Created volume successfully. Sep 02 12:51:44 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:44 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:44 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.435s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:44 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 1G Sep 02 12:51:44 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:45 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 1G" returned: 0 in 0.585s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:45 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 Sep 02 12:51:45 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-c883d3ba-afd3-4be5-b9ea-8a44d44b577e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-c883d3ba-afd3-4be5-b9ea-8a44d44b577e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Performing cascade delete. {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-745d147d-ec87-4026-a71d-d6b2f0c6a395-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-745d147d-ec87-4026-a71d-d6b2f0c6a395-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Deleting offline snapshot 745d147d-ec87-4026-a71d-d6b2f0c6a395 of volume c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] snapshot_file for this snap is: volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2871b4ce-45fa-43a7-a79f-8d540ec38c7c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:45 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:45 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:45 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59" returned: 0 in 0.535s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 is being set with open permissions: ugo+rw Sep 02 12:51:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:45 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 Sep 02 12:51:45 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:46 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.545s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770e535-1b7c-4080-8adb-aece0269ee36]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:46 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=120,cinder:SELECT=113,cinder:INSERT=37,cinder:DELETE=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:51:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82f05c17-c313-4ce7-b452-507acb74dbe9 tempest-SnapshotsActionsTest-615070369 None] Create snapshot completed successfully Sep 02 12:51:46 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:46 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-df233a51-03a1-4e68-9a17-029c9448ee59-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-df233a51-03a1-4e68-9a17-029c9448ee59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-df233a51-03a1-4e68-9a17-029c9448ee59" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-df233a51-03a1-4e68-9a17-029c9448ee59" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Deleting offline snapshot df233a51-03a1-4e68-9a17-029c9448ee59 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] snapshot_file for this snap is: volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1486f-c166-4c05-929e-a31c739b6b66]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:47 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.860s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:47 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:47 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:47 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 Sep 02 12:51:47 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:47 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:47 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0e3cb-630a-4957-b3c9-95dae9b48dec]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:47 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395 Sep 02 12:51:47 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:47 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:47 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:47 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e.745d147d-ec87-4026-a71d-d6b2f0c6a395" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-745d147d-ec87-4026-a71d-d6b2f0c6a395" released by "_delete_snapshot" :: held 2.329s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" released by "delete_snapshot" :: held 2.366s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['148698a8-4590-45b0-912c-63301c3eb061', '07045ccd-d8bf-4ed6-b50c-782c337b8e5d', '6d48504e-033a-49fc-8856-0b45b17cea35', '93e8846b-9140-4127-999b-335e9e721e23'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:47 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.446s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:48 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 Sep 02 12:51:48 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Delete snapshot completed successfully. Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-745d147d-ec87-4026-a71d-d6b2f0c6a395-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Snapshots deleted, issuing volume delete {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac98487-c318-46c6-88a4-d0ee7b299729]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:48 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:48 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:48 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:48 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59 Sep 02 12:51:48 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:48 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:48 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e Sep 02 12:51:48 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:48 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.df233a51-03a1-4e68-9a17-029c9448ee59" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-df233a51-03a1-4e68-9a17-029c9448ee59" released by "_delete_snapshot" :: held 1.832s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_snapshot" :: held 1.863s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:48 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-c883d3ba-afd3-4be5-b9ea-8a44d44b577e" released by "delete_volume" :: held 0.774s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Created reservations ['f3e894b5-8b21-4de4-a76b-7005ff2a7de3', '97e5cfd4-b234-487a-b8b1-f5ff31ce4335', 'a8b9a345-5306-4304-9c47-6157aa0b994e', '6a31f297-f652-468f-ade0-d70be29c963a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['5588f826-841f-44f9-903c-60e4ebd9f69a', '342e88bc-482e-40df-95f1-01cc83f683f5', '6276edee-0d8b-4343-af38-cc667058420c', 'cfe836d1-8cd6-49d9-aa54-a4bae5480357'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Delete snapshot completed successfully. Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dee43c48-f3a8-4979-8c8d-66104328ea81 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-df233a51-03a1-4e68-9a17-029c9448ee59-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:49 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:49 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:49 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Deleted volume successfully. Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2be40b12-e455-4498-9a81-5551f5ea6663 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-c883d3ba-afd3-4be5-b9ea-8a44d44b577e-delete_volume" released by "delete_volume" :: held 3.971s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Creating offline snapshot ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d091c1-b808-40fa-a82b-3163e280d384]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:49 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:49 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:49 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:49 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 1G Sep 02 12:51:49 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-6932be85-9313-4d52-8b63-332245182ca3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-6932be85-9313-4d52-8b63-332245182ca3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d84587-2c07-43c3-93a1-6746b8138efa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:50 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 Sep 02 12:51:50 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:50 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 1G" returned: 0 in 0.562s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:50 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 Sep 02 12:51:50 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:50 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:50 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3 Sep 02 12:51:50 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:50 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:50 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 is being set with open permissions: ugo+rw Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:50 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 Sep 02 12:51:50 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:50 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6932be85-9313-4d52-8b63-332245182ca3" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-quobyte-6932be85-9313-4d52-8b63-332245182ca3" released by "delete_volume" :: held 0.773s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Created reservations ['d466e768-2dcd-4d99-bc8e-cfd64fcad77d', '0517425d-9741-4676-8ab5-0d913b1a10a1', 'a7e960ce-9982-497f-ad66-05343e3a795b', '6eb5f3c9-4688-48f3-a815-1d93fc059a34'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:51 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:51 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:51 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5f7b85ad-ef39-491e-a19f-f59229cc04c2 tempest-SnapshotsActionsTest-615070369 None] Create snapshot completed successfully Sep 02 12:51:51 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:51:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Deleted volume successfully. Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6d0d82e-0959-4ef8-97b8-11f2bfee2c58 tempest-VolumesDeleteCascade-854263208 None] Lock "cinder-6932be85-9313-4d52-8b63-332245182ca3-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Acquiring lock "cinder-quobyte-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Deleting offline snapshot ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] snapshot_file for this snap is: volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25eb5f-7c93-4fd4-b4ef-6a42d43eeb7d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:51 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 Sep 02 12:51:51 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:52 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37bdfd6-96e4-449f-8ac4-f9eb7ba54e41]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:52 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:52 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:52 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:52 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 Sep 02 12:51:52 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:53 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" returned: 0 in 0.607s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:53 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4 Sep 02 12:51:53 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:53 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4" released by "_delete_snapshot" :: held 1.902s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_snapshot" :: held 1.933s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Created reservations ['efca328f-5940-45fa-9102-61ee564666ad', '8da8315a-677b-470b-bc8a-422895769239', '34a7cd52-2db5-4126-843f-41eb1997a019', 'b500c52e-e17e-44a4-9806-07d2ef21c201'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Delete snapshot completed successfully. Sep 02 12:51:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d50bbc7-c901-4d81-bcab-a1108b27e905 tempest-SnapshotsActionsTest-725289287 None] Lock "cinder-ff07aba8-7451-410b-9f14-c4cb0bdbd6a4-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "cinder-dcd0d655-da93-4829-a195-fb7685922b51-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-dcd0d655-da93-4829-a195-fb7685922b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "cinder-quobyte-dcd0d655-da93-4829-a195-fb7685922b51" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-dcd0d655-da93-4829-a195-fb7685922b51" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Deleting offline snapshot dcd0d655-da93-4829-a195-fb7685922b51 of volume 9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] snapshot_file for this snap is: volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[42030a8a-e2c5-424f-a7ee-4d8965de057b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:54 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:54 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:55 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9611827e-5493-44b9-887d-0246450bf262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f98b62-d0e6-4266-9366-2ff0f7cf5e4f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:55 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 Sep 02 12:51:55 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:55 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262" returned: 0 in 0.641s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:55 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:55 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:56 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:56 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51 Sep 02 12:51:56 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:56 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262.dcd0d655-da93-4829-a195-fb7685922b51" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-dcd0d655-da93-4829-a195-fb7685922b51" released by "_delete_snapshot" :: held 2.290s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_snapshot" :: held 2.330s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Created reservations ['3a6ebc84-b1e6-49da-961e-1c3cd97f9cd0', '83ddfe84-b6a5-4fa4-9f99-0e018d0cd9b9', '736235ea-4f59-44d8-acc4-6f8484b983fa', '60f2cb77-edd4-40c0-83ea-e0b50130b432'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Delete snapshot completed successfully. Sep 02 12:51:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-654cde27-b472-458f-9a3d-b4045f432e51 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-dcd0d655-da93-4829-a195-fb7685922b51-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "cinder-9611827e-5493-44b9-887d-0246450bf262-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-9611827e-5493-44b9-887d-0246450bf262-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Flow 'volume_create_manager' (1bedae75-6beb-4dc3-a1e8-e10a766bdb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8025b64e-da2f-4ccc-8d7f-68df76a01bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8025b64e-da2f-4ccc-8d7f-68df76a01bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1181464739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185c421e-6469-4638-9de7-a55a500042d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de51e4f6e1cd4ae4b2df97f256406037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:58Z,use_quota=True,user_id='8da7170fb3064d20a7bb5220ca00344c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d4a502-7493-4e5c-b6a9-ec29e293bf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d4a502-7493-4e5c-b6a9-ec29e293bf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4c40f6-9c14-4f3f-847b-fd7bcba7cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4c40f6-9c14-4f3f-847b-fd7bcba7cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185c421e-6469-4638-9de7-a55a500042d4', 'volume_name': 'volume-185c421e-6469-4638-9de7-a55a500042d4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b96703-61b1-4e5c-883d-2b250bf50459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b96703-61b1-4e5c-883d-2b250bf50459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dfab96-3a1b-49db-8d59-55bf65030460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Volume 185c421e-6469-4638-9de7-a55a500042d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185c421e-6469-4638-9de7-a55a500042d4', 'volume_size': 1} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1181464739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185c421e-6469-4638-9de7-a55a500042d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de51e4f6e1cd4ae4b2df97f256406037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:58Z,use_quota=True,user_id='8da7170fb3064d20a7bb5220ca00344c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Creating volume 185c421e-6469-4638-9de7-a55a500042d4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:51:58 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 1073741824 Sep 02 12:51:58 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6349b1-fc16-4440-b1f9-2bb5469a11d6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:58 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 Sep 02 12:51:58 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:58 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262" returned: 0 in 0.554s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:58 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262 Sep 02 12:51:58 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:59 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 1073741824" returned: 0 in 0.776s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:59 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 Sep 02 12:51:59 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:59 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9611827e-5493-44b9-887d-0246450bf262" returned: 0 in 0.519s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (7f2dcf70-5986-4ba4-a669-e49a5529b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a21af07-f56e-4bd8-bb02-16ef3609714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-quobyte-9611827e-5493-44b9-887d-0246450bf262" released by "delete_volume" :: held 1.230s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a21af07-f56e-4bd8-bb02-16ef3609714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831206637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfbaea7-946c-4e52-b84b-23fc6ea36f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:59Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b541a7-14ba-409a-bab1-cacc1ef5c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b541a7-14ba-409a-bab1-cacc1ef5c36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b262682-56d9-4bf1-bdb0-fa6582f94af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b262682-56d9-4bf1-bdb0-fa6582f94af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfbaea7-946c-4e52-b84b-23fc6ea36f9a', 'volume_name': 'volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b3931c-a742-4e32-b0e3-186d6612ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b3931c-a742-4e32-b0e3-186d6612ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e311eca-833e-4248-9132-4866f447a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Volume ebfbaea7-946c-4e52-b84b-23fc6ea36f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a', 'volume_size': 1} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831206637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfbaea7-946c-4e52-b84b-23fc6ea36f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:51:59Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Creating volume ebfbaea7-946c-4e52-b84b-23fc6ea36f9a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:51:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dfab96-3a1b-49db-8d59-55bf65030460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185c421e-6469-4638-9de7-a55a500042d4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a 1073741824 Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a6f3a5-e39e-4fc3-a664-5c8bbdffcae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:51:59 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:51:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Volume volume-185c421e-6469-4638-9de7-a55a500042d4 (185c421e-6469-4638-9de7-a55a500042d4): created successfully Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a6f3a5-e39e-4fc3-a664-5c8bbdffcae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Flow 'volume_create_manager' (1bedae75-6beb-4dc3-a1e8-e10a766bdb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:51:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-daff8e47-5d0e-4f5c-aa2c-7c0b49c2442f tempest-VolumesTransfersV357Test-31643605 None] Created volume successfully. Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Created reservations ['52a5c7de-7245-4231-a246-eff4fc647fcd', '2308e6aa-2049-4f74-8d4e-7d9e30024b25', '8c24597e-4527-431e-974b-28b2e61056d0', '1c497759-b941-4a7b-8dd1-2b9e4c710e70'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:51:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:51:59 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:51:59 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (870e48e4-f0c4-4cdb-a8da-b0a31958a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3e5c24-5f4d-4f18-8f8c-ce05296c2af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.554s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Deleted volume successfully. Sep 02 12:52:00 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3e5c24-5f4d-4f18-8f8c-ce05296c2af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371417651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2566db-7875-4896-ad2e-da4c5a078d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:00Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8be1f05-7bbc-42b6-9b5a-4203f33bd184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8be1f05-7bbc-42b6-9b5a-4203f33bd184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b41c29-ca95-499a-a7f6-2bad40729107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b41c29-ca95-499a-a7f6-2bad40729107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2566db-7875-4896-ad2e-da4c5a078d40', 'volume_name': 'volume-6d2566db-7875-4896-ad2e-da4c5a078d40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8e931d-4225-405f-951c-c0d887a3f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8e931d-4225-405f-951c-c0d887a3f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473e3c84-2c9a-4819-a676-a628cabb0e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Volume 6d2566db-7875-4896-ad2e-da4c5a078d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2566db-7875-4896-ad2e-da4c5a078d40', 'volume_size': 1} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a 1073741824" returned: 0 in 0.890s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3069ad4-284b-43d4-b204-8ae49f461574 tempest-SnapshotsActionsTest-615070369 None] Lock "cinder-9611827e-5493-44b9-887d-0246450bf262-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:00 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a Sep 02 12:52:00 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:00 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371417651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2566db-7875-4896-ad2e-da4c5a078d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:00Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Creating volume 6d2566db-7875-4896-ad2e-da4c5a078d40 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e311eca-833e-4248-9132-4866f447a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32954d72-5d50-4eb8-aeab-d6c6da793c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Volume volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a (ebfbaea7-946c-4e52-b84b-23fc6ea36f9a): created successfully Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32954d72-5d50-4eb8-aeab-d6c6da793c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:00 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 1073741824 Sep 02 12:52:00 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (7f2dcf70-5986-4ba4-a669-e49a5529b041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-53f7a5c3-7568-432e-80d5-7eec4a968698 tempest-AttachVolumeNegativeTest-1587220222 None] Created volume successfully. Sep 02 12:52:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f8020b10-4fc3-4d75-8e82-8fc76ad33470 tempest-VolumesTransfersV357Test-1206074878 None] Transfer volume completed successfully. Sep 02 12:52:01 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 1073741824" returned: 0 in 0.757s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:01 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 Sep 02 12:52:01 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:02 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473e3c84-2c9a-4819-a676-a628cabb0e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2566db-7875-4896-ad2e-da4c5a078d40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c177be30-8012-47d3-a26c-88b92a884417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Volume volume-6d2566db-7875-4896-ad2e-da4c5a078d40 (6d2566db-7875-4896-ad2e-da4c5a078d40): created successfully Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c177be30-8012-47d3-a26c-88b92a884417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (870e48e4-f0c4-4cdb-a8da-b0a31958a475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c6214585-d9cd-4a07-9c16-988618e0739f tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "cinder-185c421e-6469-4638-9de7-a55a500042d4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-185c421e-6469-4638-9de7-a55a500042d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "cinder-quobyte-185c421e-6469-4638-9de7-a55a500042d4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-quobyte-185c421e-6469-4638-9de7-a55a500042d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ae92a8-1368-45a4-bbb5-9571cc6467ee]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:02 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 Sep 02 12:52:02 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-92c1a668-1e2a-4132-9d28-bd836a9238c2 req-457fc39c-a950-4ca3-a3cb-cfc8f46ad8b5 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-92c1a668-1e2a-4132-9d28-bd836a9238c2 req-457fc39c-a950-4ca3-a3cb-cfc8f46ad8b5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-92c1a668-1e2a-4132-9d28-bd836a9238c2 req-457fc39c-a950-4ca3-a3cb-cfc8f46ad8b5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-92c1a668-1e2a-4132-9d28-bd836a9238c2 req-457fc39c-a950-4ca3-a3cb-cfc8f46ad8b5 tempest-AttachVolumeNegativeTest-1587220222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0784782e-8d11-44f8-918e-caba7eea3baa', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:52:02 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=119,cinder:INSERT=29,cinder:UPDATE=131,cinder:DELETE=13 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:52:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-92c1a668-1e2a-4132-9d28-bd836a9238c2 req-457fc39c-a950-4ca3-a3cb-cfc8f46ad8b5 tempest-AttachVolumeNegativeTest-1587220222 None] attachment_update completed successfully. Sep 02 12:52:03 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4" returned: 0 in 0.580s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:03 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4 Sep 02 12:52:03 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff972697-c03c-4520-af66-3df4ea2b5054 tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff972697-c03c-4520-af66-3df4ea2b5054 tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40" acquired by "attach_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff972697-c03c-4520-af66-3df4ea2b5054 tempest-VolumesActionsTest-392679636 None] Attaching volume 6d2566db-7875-4896-ad2e-da4c5a078d40 to instance 0039df56-066e-4d18-af9d-5879ae6ddf25 at mountpoint /dev/vdb on host None. Sep 02 12:52:03 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-185c421e-6469-4638-9de7-a55a500042d4" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-quobyte-185c421e-6469-4638-9de7-a55a500042d4" released by "delete_volume" :: held 1.207s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff972697-c03c-4520-af66-3df4ea2b5054 tempest-VolumesActionsTest-392679636 None] Attach volume completed successfully. Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff972697-c03c-4520-af66-3df4ea2b5054 tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40" released by "attach_volume" :: held 0.285s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Created reservations ['3cc0070c-28a4-4e87-aa2b-4e8aafe67621', '51f4f22d-9601-41fd-9a8c-0f9b9a8f6aae', '4580db07-bf2d-46f8-80a0-4036f8b63e57', 'cedb4917-82eb-4c5d-91aa-78c568acdac4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:04 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:04 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:04 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Deleted volume successfully. Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b6daa930-1233-42b2-9323-f14e2aff8e16 tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-185c421e-6469-4638-9de7-a55a500042d4-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Terminate volume connection completed successfully. Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Detaching volume 6d2566db-7875-4896-ad2e-da4c5a078d40 from instance 0039df56-066e-4d18-af9d-5879ae6ddf25. Sep 02 12:52:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Detach volume completed successfully. Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9221b8d-a6f8-4942-9a49-15f0de748afd tempest-VolumesActionsTest-1307230054 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-99fc8942-020e-48ed-b486-93234ed7868a tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-99fc8942-020e-48ed-b486-93234ed7868a tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-99fc8942-020e-48ed-b486-93234ed7868a tempest-VolumesActionsTest-392679636 None] Volume detach called, but volume not attached. Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-99fc8942-020e-48ed-b486-93234ed7868a tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Flow 'volume_create_manager' (0d3f6e1a-8f2c-4ef4-b577-551de5c3e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae98222-f571-4745-821a-d596ea1e53d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae98222-f571-4745-821a-d596ea1e53d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-563587530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a388b981-1049-4249-ac59-3b7a650fc119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de51e4f6e1cd4ae4b2df97f256406037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:06Z,use_quota=True,user_id='8da7170fb3064d20a7bb5220ca00344c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f021829e-a274-4db3-94b7-3f969170a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f021829e-a274-4db3-94b7-3f969170a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3302a5d4-601d-48cc-92e1-ad0f10a0a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3302a5d4-601d-48cc-92e1-ad0f10a0a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a388b981-1049-4249-ac59-3b7a650fc119', 'volume_name': 'volume-a388b981-1049-4249-ac59-3b7a650fc119', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d95d2dc-bb74-4abd-bf31-22d5ecb2167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d95d2dc-bb74-4abd-bf31-22d5ecb2167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acd3d9c-9b18-44a3-a3cb-3d4905e9a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Volume a388b981-1049-4249-ac59-3b7a650fc119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a388b981-1049-4249-ac59-3b7a650fc119', 'volume_size': 1} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-563587530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a388b981-1049-4249-ac59-3b7a650fc119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de51e4f6e1cd4ae4b2df97f256406037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:06Z,use_quota=True,user_id='8da7170fb3064d20a7bb5220ca00344c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Creating volume a388b981-1049-4249-ac59-3b7a650fc119 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:06 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 1073741824 Sep 02 12:52:06 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-quobyte-6d2566db-7875-4896-ad2e-da4c5a078d40" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "cinder-quobyte-6d2566db-7875-4896-ad2e-da4c5a078d40" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5646e1-f4b7-4cca-baf4-cf00f5d7c75d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:06 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 Sep 02 12:52:06 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-07a85416-8919-4995-8eaf-bfa3e21b5194 req-46aa0119-28de-4087-b9b7-ac86c1fb6799 tempest-AttachVolumeNegativeTest-1587220222 None] Terminate volume connection completed successfully. Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-07a85416-8919-4995-8eaf-bfa3e21b5194 req-46aa0119-28de-4087-b9b7-ac86c1fb6799 tempest-AttachVolumeNegativeTest-1587220222 None] Deleting attachment 0784782e-8d11-44f8-918e-caba7eea3baa. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:52:06 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40" returned: 0 in 0.611s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:06 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 1073741824" returned: 0 in 0.829s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:06 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40 Sep 02 12:52:06 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:06 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 Sep 02 12:52:06 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:07 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:07 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6d2566db-7875-4896-ad2e-da4c5a078d40" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acd3d9c-9b18-44a3-a3cb-3d4905e9a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a388b981-1049-4249-ac59-3b7a650fc119', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1481ec6c-3e29-46d6-b120-60f3f2737435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "cinder-quobyte-6d2566db-7875-4896-ad2e-da4c5a078d40" released by "delete_volume" :: held 1.172s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Volume volume-a388b981-1049-4249-ac59-3b7a650fc119 (a388b981-1049-4249-ac59-3b7a650fc119): created successfully Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1481ec6c-3e29-46d6-b120-60f3f2737435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Flow 'volume_create_manager' (0d3f6e1a-8f2c-4ef4-b577-551de5c3e76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-80b8dd0a-4597-4e79-b52c-9b6d01058bec tempest-VolumesTransfersV357Test-31643605 None] Created volume successfully. Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Created reservations ['b71a95a3-3d05-4d80-a645-6cff51e3a929', 'ed329f67-52b7-4f81-93ea-1bd5acde92d3', 'd8c5a3b2-f83d-41e2-9057-4b2ac79a4c40', 'effb0aed-255d-4ffa-91de-7bd0658ef174'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:07 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:07 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:07 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:07 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Deleted volume successfully. Sep 02 12:52:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bb81b649-f29a-49da-b871-5053f5d224d9 tempest-VolumesActionsTest-392679636 None] Lock "cinder-6d2566db-7875-4896-ad2e-da4c5a078d40-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "cinder-a388b981-1049-4249-ac59-3b7a650fc119-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-a388b981-1049-4249-ac59-3b7a650fc119-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "cinder-quobyte-a388b981-1049-4249-ac59-3b7a650fc119" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-quobyte-a388b981-1049-4249-ac59-3b7a650fc119" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90188ca-8524-4e46-9a5d-9cf01f9a8aec]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:09 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 Sep 02 12:52:09 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:09 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119" returned: 0 in 0.649s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:09 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119 Sep 02 12:52:09 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Flow 'volume_create_manager' (660ed94c-f4df-4dc9-add3-4ff7fe5d4b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3a28ae-45ea-4790-954d-94bd34f12827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3a28ae-45ea-4790-954d-94bd34f12827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-56557179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc7c925-95f7-448d-bece-982a543c39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48119bc5c74448d88bffe7c9d38e638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:10Z,use_quota=True,user_id='30eefbb964e042a299e8a20133430b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b4fac-6436-44ce-81d1-1029f618ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b4fac-6436-44ce-81d1-1029f618ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf45b98-6545-438a-8c92-b61df7a0df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf45b98-6545-438a-8c92-b61df7a0df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc7c925-95f7-448d-bece-982a543c39c7', 'volume_name': 'volume-8bc7c925-95f7-448d-bece-982a543c39c7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a5beb-255c-4f63-ae8a-c981afa9936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a5beb-255c-4f63-ae8a-c981afa9936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d567dae-f069-494f-8673-4fe9ac288f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Volume 8bc7c925-95f7-448d-bece-982a543c39c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc7c925-95f7-448d-bece-982a543c39c7', 'volume_size': 1} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-56557179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc7c925-95f7-448d-bece-982a543c39c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48119bc5c74448d88bffe7c9d38e638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:10Z,use_quota=True,user_id='30eefbb964e042a299e8a20133430b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Creating volume 8bc7c925-95f7-448d-bece-982a543c39c7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:10 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 1073741824 Sep 02 12:52:10 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:10 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a388b981-1049-4249-ac59-3b7a650fc119" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-quobyte-a388b981-1049-4249-ac59-3b7a650fc119" released by "delete_volume" :: held 1.185s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Created reservations ['2b9e6df4-46b3-45bf-9ae4-77d4a4229b6b', 'c469d447-ff0b-49fb-a384-1b9d6eb127bb', '9a5fa7a7-12ca-4f76-b76d-05324ed119ed', '405060e2-f9ba-4bf0-9054-253db771ae2a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:10 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:10 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:10 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Deleted volume successfully. Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-304eec68-2ea5-41a9-8029-a71795a6ff7d tempest-VolumesTransfersV357Test-748553643 None] Lock "cinder-a388b981-1049-4249-ac59-3b7a650fc119-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:10 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 1073741824" returned: 0 in 0.755s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:10 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 Sep 02 12:52:10 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:11 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d567dae-f069-494f-8673-4fe9ac288f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc7c925-95f7-448d-bece-982a543c39c7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0f5bf6-05df-4d82-86f6-a6026c6e87c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Volume volume-8bc7c925-95f7-448d-bece-982a543c39c7 (8bc7c925-95f7-448d-bece-982a543c39c7): created successfully Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0f5bf6-05df-4d82-86f6-a6026c6e87c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Flow 'volume_create_manager' (660ed94c-f4df-4dc9-add3-4ff7fe5d4b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5bd4338d-a6b8-42ef-b5d3-fd5e04167c48 tempest-VolumeQuotasNegativeTestJSON-429160338 None] Created volume successfully. Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Acquiring lock "cinder-8bc7c925-95f7-448d-bece-982a543c39c7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "cinder-8bc7c925-95f7-448d-bece-982a543c39c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (542dc4e7-bda6-47c7-a6d8-8ca351ddcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34504ac-a2c0-4678-ae01-cd4a2dc52532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34504ac-a2c0-4678-ae01-cd4a2dc52532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295738973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ae7ed3-a525-4526-b3a8-1898c2fcba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:13Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2854ab56-6c8e-4e26-a4b5-4d1420170ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2854ab56-6c8e-4e26-a4b5-4d1420170ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b56153b-7bb7-4c45-9433-344c2ba76432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b56153b-7bb7-4c45-9433-344c2ba76432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ae7ed3-a525-4526-b3a8-1898c2fcba68', 'volume_name': 'volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa8189b-6aad-459c-9d94-22377e656a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa8189b-6aad-459c-9d94-22377e656a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3112fdfa-ee8c-4ba3-87b3-082a4e672c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Volume 65ae7ed3-a525-4526-b3a8-1898c2fcba68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68', 'volume_size': 1} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295738973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ae7ed3-a525-4526-b3a8-1898c2fcba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:13Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Creating volume 65ae7ed3-a525-4526-b3a8-1898c2fcba68 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:13 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Acquiring lock "cinder-quobyte-8bc7c925-95f7-448d-bece-982a543c39c7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:13 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 1073741824 Sep 02 12:52:13 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "cinder-quobyte-8bc7c925-95f7-448d-bece-982a543c39c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4137bc-7ad3-45c1-9b9b-cc31b0891acb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:13 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 Sep 02 12:52:13 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:14 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7" returned: 0 in 0.473s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:14 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 1073741824" returned: 0 in 0.597s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:14 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7 Sep 02 12:52:14 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:14 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 Sep 02 12:52:14 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:14 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8bc7c925-95f7-448d-bece-982a543c39c7" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "cinder-quobyte-8bc7c925-95f7-448d-bece-982a543c39c7" released by "delete_volume" :: held 0.938s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Created reservations ['cf8fc5dd-0080-4966-b6ca-db47e52e17a5', '70faa9c5-b9b9-4cd1-9442-7b6a94717428', 'e9804a03-faec-4dd1-8b45-eac2bcedd490', '98f64d01-6517-4952-bc72-0bedb75b7f39'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:14 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3112fdfa-ee8c-4ba3-87b3-082a4e672c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19db8cd8-a1ca-456c-afdb-c4e41bb1954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:14 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Volume volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 (65ae7ed3-a525-4526-b3a8-1898c2fcba68): created successfully Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19db8cd8-a1ca-456c-afdb-c4e41bb1954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (542dc4e7-bda6-47c7-a6d8-8ca351ddcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1effd8a-1927-462f-b70a-9b8c87d3432a tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:14 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:14 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:14 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.293s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Deleted volume successfully. Sep 02 12:52:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a89a5982-1c00-4498-be5d-ae3fe6148c1f tempest-VolumeQuotasNegativeTestJSON-429160338 None] Lock "cinder-8bc7c925-95f7-448d-bece-982a543c39c7-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-65ae7ed3-a525-4526-b3a8-1898c2fcba68-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-65ae7ed3-a525-4526-b3a8-1898c2fcba68-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-quobyte-65ae7ed3-a525-4526-b3a8-1898c2fcba68" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-65ae7ed3-a525-4526-b3a8-1898c2fcba68" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ee472-0e55-40ae-a7ce-a8f9da92f660]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:15 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 Sep 02 12:52:15 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:16 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:16 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68 Sep 02 12:52:16 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:16 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-65ae7ed3-a525-4526-b3a8-1898c2fcba68" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-65ae7ed3-a525-4526-b3a8-1898c2fcba68" released by "delete_volume" :: held 1.003s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Created reservations ['96bdc03c-f0a2-456d-bed8-4eaa4a32be28', 'f7f7f475-b307-4717-91b5-5fbd3bace5bf', '9252765d-af1b-4bc7-a874-ea0ff8fb629c', '30c5ac09-565c-4209-93d9-b7fd6f94abca'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:16 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:16 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:17 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:17 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Deleted volume successfully. Sep 02 12:52:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ee88cb-68ad-49df-b533-5cc50608c1e8 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-65ae7ed3-a525-4526-b3a8-1898c2fcba68-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (21ad8ba1-6f0a-4412-8900-9fc0c9b43c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a25c15b-6cb0-474a-beb5-61609ee745dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Flow 'volume_create_manager' (a61dc0b7-27e7-478d-aab4-5f1aab6cc70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156614e2-6d44-413d-a271-34626fb505e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a25c15b-6cb0-474a-beb5-61609ee745dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-391725329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42935591-a969-4e73-a170-fb7f3c6204cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:19Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d9baa-914f-4a7c-9a59-fb5f3b534760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d9baa-914f-4a7c-9a59-fb5f3b534760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e69e302-50a5-475d-90d8-ab5f56949be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e69e302-50a5-475d-90d8-ab5f56949be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42935591-a969-4e73-a170-fb7f3c6204cf', 'volume_name': 'volume-42935591-a969-4e73-a170-fb7f3c6204cf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c455ec11-0504-4cb1-a380-715e879a3251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c455ec11-0504-4cb1-a380-715e879a3251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85932bc7-df4a-4177-9d7d-afddccb0f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Volume 42935591-a969-4e73-a170-fb7f3c6204cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42935591-a969-4e73-a170-fb7f3c6204cf', 'volume_size': 1} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-391725329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42935591-a969-4e73-a170-fb7f3c6204cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:19Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Creating volume 42935591-a969-4e73-a170-fb7f3c6204cf {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:19 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf 1073741824 Sep 02 12:52:19 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156614e2-6d44-413d-a271-34626fb505e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1471162475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c11c2a-da60-4702-9f7c-115b031c3891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612bb17de9243f79571985af71d9508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:19Z,use_quota=True,user_id='c21e37997d7547ddb34b663635d82649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a965d3e-da1c-460a-8063-b66589a7e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a965d3e-da1c-460a-8063-b66589a7e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f234c0-bbaa-41fd-8630-b878d78c4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f234c0-bbaa-41fd-8630-b878d78c4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c11c2a-da60-4702-9f7c-115b031c3891', 'volume_name': 'volume-06c11c2a-da60-4702-9f7c-115b031c3891', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c09ef1-f82b-48b1-85bf-f708642dde0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c09ef1-f82b-48b1-85bf-f708642dde0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d604cc7f-7991-4590-9d64-84a3203031b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Volume 06c11c2a-da60-4702-9f7c-115b031c3891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c11c2a-da60-4702-9f7c-115b031c3891', 'volume_size': 1} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:19 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf 1073741824" returned: 0 in 0.647s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:20 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf Sep 02 12:52:20 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:20 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1471162475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c11c2a-da60-4702-9f7c-115b031c3891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612bb17de9243f79571985af71d9508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:19Z,use_quota=True,user_id='c21e37997d7547ddb34b663635d82649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Creating volume 06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:20 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85932bc7-df4a-4177-9d7d-afddccb0f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42935591-a969-4e73-a170-fb7f3c6204cf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef69307-bde7-43c0-b237-c0daa6c07ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:20 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 1073741824 Sep 02 12:52:20 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Volume volume-42935591-a969-4e73-a170-fb7f3c6204cf (42935591-a969-4e73-a170-fb7f3c6204cf): created successfully Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef69307-bde7-43c0-b237-c0daa6c07ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (21ad8ba1-6f0a-4412-8900-9fc0c9b43c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7320fd1b-aabb-4ea1-8070-163a951117a5 tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:20 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 1073741824" returned: 0 in 0.612s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:21 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:21 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-42935591-a969-4e73-a170-fb7f3c6204cf-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-42935591-a969-4e73-a170-fb7f3c6204cf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-quobyte-42935591-a969-4e73-a170-fb7f3c6204cf" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-42935591-a969-4e73-a170-fb7f3c6204cf" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf05381-db89-4d36-bfe5-ead04b90e060]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:21 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d604cc7f-7991-4590-9d64-84a3203031b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c11c2a-da60-4702-9f7c-115b031c3891', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bafa780-a39a-4750-9ba6-073bfb0e80ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:21 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf Sep 02 12:52:21 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Volume volume-06c11c2a-da60-4702-9f7c-115b031c3891 (06c11c2a-da60-4702-9f7c-115b031c3891): created successfully Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bafa780-a39a-4750-9ba6-073bfb0e80ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Flow 'volume_create_manager' (a61dc0b7-27e7-478d-aab4-5f1aab6cc70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-022a8345-cbc8-4539-a986-be46ab8720a2 tempest-VolumesCloneTest-1253891310 None] Created volume successfully. Sep 02 12:52:21 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf" returned: 0 in 0.536s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:21 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf Sep 02 12:52:21 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:22 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-42935591-a969-4e73-a170-fb7f3c6204cf" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-42935591-a969-4e73-a170-fb7f3c6204cf" released by "delete_volume" :: held 0.940s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Created reservations ['75b48d40-a1c2-4b3f-8a3f-d3b5107e9d34', 'dc320a8c-8b54-4e7b-b62d-4c25214b35b4', '5666535a-aca1-466f-b9f5-16bced13a42d', '31bd5c5a-62a8-4cd5-963c-e40e5947ef34'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:22 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:22 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Flow 'volume_create_manager' (4eb5d563-a9b7-4e94-9498-277a51e52286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea739bb-bf8b-47c9-873a-7cfde591df40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea739bb-bf8b-47c9-873a-7cfde591df40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1964911007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9d0a11-3dec-47ca-a28d-8046207f2f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612bb17de9243f79571985af71d9508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=06c11c2a-da60-4702-9f7c-115b031c3891,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:23Z,use_quota=True,user_id='c21e37997d7547ddb34b663635d82649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da16ca0-b7f6-4d01-b352-0fa169303243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da16ca0-b7f6-4d01-b352-0fa169303243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414f2874-658f-40d4-9329-31f3f5c484f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:23 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414f2874-658f-40d4-9329-31f3f5c484f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ab9d0a11-3dec-47ca-a28d-8046207f2f2e', 'volume_name': 'volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e', 'volume_size': 2, 'source_volid': '06c11c2a-da60-4702-9f7c-115b031c3891', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c23887-dc79-4e3c-bad6-bd42b948c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c23887-dc79-4e3c-bad6-bd42b948c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271c4cf3-c1b8-4748-a02f-6721a6183a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Volume ab9d0a11-3dec-47ca-a28d-8046207f2f2e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e', 'volume_size': 2, 'source_volid': '06c11c2a-da60-4702-9f7c-115b031c3891', 'source_volstatus': 'available'} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.830s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Deleted volume successfully. Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Cloning volume 06c11c2a-da60-4702-9f7c-115b031c3891 to volume ab9d0a11-3dec-47ca-a28d-8046207f2f2e Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61ef16ce-2c2a-444b-9e79-8eb99776e011 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-42935591-a969-4e73-a170-fb7f3c6204cf-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Creating offline snapshot 8e6b171a-c772-4c6d-8783-3692de8c238d of volume 06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a70662-d72b-4963-bc53-4c244bbc37e5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:23 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:23 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:24 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.981s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:24 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d 1G Sep 02 12:52:24 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (9ab29acc-192d-426a-ad52-7d05c6ae9551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7b8e58-8f2b-41c3-b75f-63079ce14ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Flow 'volume_create_manager' (7ae82472-ca11-4eba-810f-e701636b0946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b9c1a0-ee39-4cd0-8ade-be7cb2c12870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7b8e58-8f2b-41c3-b75f-63079ce14ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980376032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a657d26-bca4-45ad-93f1-1f024d424d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:24Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f10da14-d0ad-4534-b64b-a394b228af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f10da14-d0ad-4534-b64b-a394b228af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8b13b8-0da8-41de-89d8-2b49f369a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8b13b8-0da8-41de-89d8-2b49f369a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a657d26-bca4-45ad-93f1-1f024d424d5a', 'volume_name': 'volume-5a657d26-bca4-45ad-93f1-1f024d424d5a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d62fd06-18e8-42cf-a469-a7b200ee5fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d62fd06-18e8-42cf-a469-a7b200ee5fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34da629-62be-4c93-bdff-08a7eae0d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Volume 5a657d26-bca4-45ad-93f1-1f024d424d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a657d26-bca4-45ad-93f1-1f024d424d5a', 'volume_size': 1} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b9c1a0-ee39-4cd0-8ade-be7cb2c12870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2145350469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16af745e207248cfa06232695756f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:24Z,use_quota=True,user_id='1004e34e81204f49bfec380e53965625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5818807e-ed0e-41a5-a55f-ad96b81fec6e),volume_type_id=5818807e-ed0e-41a5-a55f-ad96b81fec6e)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c094b3-78cc-4a77-93af-af22fdbd32ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c094b3-78cc-4a77-93af-af22fdbd32ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e0eb38-8ec9-4ec8-b399-0a7855761fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e0eb38-8ec9-4ec8-b399-0a7855761fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1', 'volume_name': 'volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8868716-2fcf-49e8-985b-fa38e8aacc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8868716-2fcf-49e8-985b-fa38e8aacc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5ce9d-0a2e-42cc-9a44-66577807dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Volume 8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1', 'volume_size': 1} Sep 02 12:52:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:25 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d 1G" returned: 0 in 0.647s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c11c2a-da60-4702-9f7c-115b031c3891 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:25 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c11c2a-da60-4702-9f7c-115b031c3891 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:25 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:25 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c11c2a-da60-4702-9f7c-115b031c3891 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d is being set with open permissions: ugo+rw Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:25 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:25 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:25 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:25 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info Sep 02 12:52:25 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:25 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info is being set with open permissions: ugo+rw Sep 02 12:52:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:26 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info Sep 02 12:52:26 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:26 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.info" returned: 0 in 0.324s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] snapshot: 8e6b171a-c772-4c6d-8783-3692de8c238d, volume: ab9d0a11-3dec-47ca-a28d-8046207f2f2e, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ad3c3-6c86-4114-80a0-e897b1bb2921]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:26 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:26 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:26 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c11c2a-da60-4702-9f7c-115b031c3891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b90cd8-8adf-46a6-9905-5a0491e096da]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:26 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:26 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:27 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.683s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:52:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:52:27 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:52:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:27 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e Sep 02 12:52:27 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:33 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" returned: 0 in 5.770s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:52:33 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Converted 1024.00 MB image at 177.42 MB/s Sep 02 12:52:33 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e is being set with open permissions: ugo+rw Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:33 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e Sep 02 12:52:33 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:33 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" released by "_copy_volume_from_snapshot" :: held 7.207s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-quobyte-8e6b171a-c772-4c6d-8783-3692de8c238d" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-8e6b171a-c772-4c6d-8783-3692de8c238d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Deleting offline snapshot 8e6b171a-c772-4c6d-8783-3692de8c238d of volume 06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] snapshot_file for this snap is: volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8510b91c-5b18-47f4-881e-1502d0858586]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:33 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:33 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:33 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c11c2a-da60-4702-9f7c-115b031c3891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a052c4c5-550b-4ea3-86eb-262d2b67a08e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:34 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:34 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:34 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:34 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:34 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:34 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:34 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d Sep 02 12:52:34 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:35 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891.8e6b171a-c772-4c6d-8783-3692de8c238d" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-8e6b171a-c772-4c6d-8783-3692de8c238d" released by "_delete_snapshot" :: held 1.560s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.901s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.497s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980376032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a657d26-bca4-45ad-93f1-1f024d424d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:24Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Creating volume 5a657d26-bca4-45ad-93f1-1f024d424d5a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271c4cf3-c1b8-4748-a02f-6721a6183a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e', 'volume_size': 2, 'source_volid': '06c11c2a-da60-4702-9f7c-115b031c3891', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:35 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a 1073741824 Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c0558-1f94-423c-9b94-a9d7ab608fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:35 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Volume volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e (ab9d0a11-3dec-47ca-a28d-8046207f2f2e): created successfully Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c0558-1f94-423c-9b94-a9d7ab608fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Flow 'volume_create_manager' (4eb5d563-a9b7-4e94-9498-277a51e52286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0ae7e849-a9c3-4bb2-bf6a-c4d6639d4d50 tempest-VolumesCloneTest-1253891310 None] Created volume successfully. Sep 02 12:52:35 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a 1073741824" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:35 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a Sep 02 12:52:35 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:35 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.135s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2145350469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16af745e207248cfa06232695756f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:24Z,use_quota=True,user_id='1004e34e81204f49bfec380e53965625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5818807e-ed0e-41a5-a55f-ad96b81fec6e),volume_type_id=5818807e-ed0e-41a5-a55f-ad96b81fec6e)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Creating volume 8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34da629-62be-4c93-bdff-08a7eae0d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a657d26-bca4-45ad-93f1-1f024d424d5a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0271486a-964d-495f-97a3-93ac9c27eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:35 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 1073741824 Sep 02 12:52:35 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Volume volume-5a657d26-bca4-45ad-93f1-1f024d424d5a (5a657d26-bca4-45ad-93f1-1f024d424d5a): created successfully Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0271486a-964d-495f-97a3-93ac9c27eabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (9ab29acc-192d-426a-ad52-7d05c6ae9551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c99f87ae-7e08-4e3b-9f08-a4578776c855 tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-ab9d0a11-3dec-47ca-a28d-8046207f2f2e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-ab9d0a11-3dec-47ca-a28d-8046207f2f2e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b9bcd6-db7e-4388-b118-af44c1ef5914]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-5a657d26-bca4-45ad-93f1-1f024d424d5a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-5a657d26-bca4-45ad-93f1-1f024d424d5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-quobyte-5a657d26-bca4-45ad-93f1-1f024d424d5a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:36 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-5a657d26-bca4-45ad-93f1-1f024d424d5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 1073741824" returned: 0 in 0.701s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:36 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e Sep 02 12:52:36 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[87445b78-d5dd-4202-afe5-a01d76ec5d0f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:36 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 Sep 02 12:52:36 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:36 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a Sep 02 12:52:36 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:36 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" returned: 0 in 0.414s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:36 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:36 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e Sep 02 12:52:36 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5ce9d-0a2e-42cc-9a44-66577807dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf6442f-c80a-4214-b8db-ec0ad2b657b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Volume volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 (8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1): created successfully Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf6442f-c80a-4214-b8db-ec0ad2b657b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Flow 'volume_create_manager' (7ae82472-ca11-4eba-810f-e701636b0946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-90da2893-af11-4ed1-a188-f103284ca3ba tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Created volume successfully. Sep 02 12:52:37 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:37 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a Sep 02 12:52:37 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:37 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-ab9d0a11-3dec-47ca-a28d-8046207f2f2e" released by "delete_volume" :: held 0.721s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Created reservations ['635a4d0c-57aa-4e66-9bf9-ba21a14b2b59', 'ce0b9d8a-dd4f-4f22-9cfe-53cd96a0579a', '1c19cbe4-bfed-4d4b-b6b8-cfee6e3f0732', '7110f4c8-6f0f-4f22-aaf4-843daae04c52'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:37 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5a657d26-bca4-45ad-93f1-1f024d424d5a" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:37 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-5a657d26-bca4-45ad-93f1-1f024d424d5a" released by "delete_volume" :: held 0.712s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Created reservations ['b9197f2e-f1ab-45b4-8617-c7c4790401f1', 'df827dd2-5795-42c1-8cc3-acdb26196154', 'd55f2552-670a-4ab0-8a11-83861b7a76f0', '68e3b264-86cb-4983-9678-eb3f2b75af4b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:37 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:37 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:37 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:37 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:37 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Deleted volume successfully. Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81708128-dedc-44fa-b621-21c85011cd05 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-ab9d0a11-3dec-47ca-a28d-8046207f2f2e-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-06c11c2a-da60-4702-9f7c-115b031c3891-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-06c11c2a-da60-4702-9f7c-115b031c3891-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:37 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "cinder-quobyte-06c11c2a-da60-4702-9f7c-115b031c3891" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-06c11c2a-da60-4702-9f7c-115b031c3891" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:37 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Deleted volume successfully. Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be90230-dd10-4368-89c0-86a46aab4fe1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e9c3a4e-7460-4f10-8e02-a0838c4917c9 tempest-VolumesActionsTest-1307230054 None] Lock "cinder-5a657d26-bca4-45ad-93f1-1f024d424d5a-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:38 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:38 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:38 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:38 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:38 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:38 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891 Sep 02 12:52:38 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (9720ff64-7fc2-4e20-be6c-d8c5321603d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406178e-e72a-4e60-bbeb-fa3c29603a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:38 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406178e-e72a-4e60-bbeb-fa3c29603a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-342426580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3e8ac6-b47d-45b7-b697-32c335065fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:38Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e064bdd-138d-4de7-9f6d-5ed0775a2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e064bdd-138d-4de7-9f6d-5ed0775a2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff317a1-ef91-4132-826b-142ff1fdf495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff317a1-ef91-4132-826b-142ff1fdf495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3e8ac6-b47d-45b7-b697-32c335065fb7', 'volume_name': 'volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6935be03-9b3c-4d23-af31-f5ade6eae0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6935be03-9b3c-4d23-af31-f5ade6eae0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea69381-046c-4da7-9901-b7af97bf586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Volume 5e3e8ac6-b47d-45b7-b697-32c335065fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7', 'volume_size': 1} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-342426580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3e8ac6-b47d-45b7-b697-32c335065fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:38Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Creating volume 5e3e8ac6-b47d-45b7-b697-32c335065fb7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-79bbe41c-2fa8-4998-9330-9d7c0bef2443 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Retype volume completed successfully. Sep 02 12:52:38 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 1073741824 Sep 02 12:52:38 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:38 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-06c11c2a-da60-4702-9f7c-115b031c3891" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-quobyte-06c11c2a-da60-4702-9f7c-115b031c3891" released by "delete_volume" :: held 0.845s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Created reservations ['bec1d75d-5fdf-434b-9e3e-f5b7c9eec9d0', '7abeaf49-fc2b-45b9-92b5-c9964da76a87', '8bcbf815-83e5-4142-a7d8-d9f5ac825460', '5fab84a2-1e45-4127-95d2-999b273ca337'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:38 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:38 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:39 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Deleted volume successfully. Sep 02 12:52:39 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 1073741824" returned: 0 in 0.494s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36a6d927-bc49-43fe-a38e-140cb73cd2c9 tempest-VolumesCloneTest-1253891310 None] Lock "cinder-06c11c2a-da60-4702-9f7c-115b031c3891-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:39 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 Sep 02 12:52:39 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:39 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea69381-046c-4da7-9901-b7af97bf586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a783f4-8d41-4c42-aa55-465cef464faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Volume volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 (5e3e8ac6-b47d-45b7-b697-32c335065fb7): created successfully Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a783f4-8d41-4c42-aa55-465cef464faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (9720ff64-7fc2-4e20-be6c-d8c5321603d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "cinder-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e3224bce-d25f-4a07-9132-dcfc7a322002 tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "cinder-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "cinder-quobyte-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "cinder-quobyte-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad58453-2f41-40e7-a8e9-5acace3bf216]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:39 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 Sep 02 12:52:39 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:39 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:40 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1 Sep 02 12:52:40 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:40 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "cinder-quobyte-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1" released by "delete_volume" :: held 0.689s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:40 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:52:40 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Created reservations ['dc5f6494-e6c9-43b3-9d36-1dc9a01c33bc', '61fbdb26-d525-4799-8cfa-bdd0b3cf4b45', 'ad1a8087-6a58-4bb7-9a01-49b8491d87ce', '84186820-fd0b-416b-a9f2-3a2b7a550f44'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:40 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:40 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:40 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Deleted volume successfully. Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5c26a95-32d3-436a-a65a-797db953b269 tempest-VolumeRetypeWithoutMigrationTest-1229026595 None] Lock "cinder-8dfd8b55-b0f1-4d16-bdf3-f7ebf109b1d1-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-5e3e8ac6-b47d-45b7-b697-32c335065fb7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "cinder-5e3e8ac6-b47d-45b7-b697-32c335065fb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Acquiring lock "cinder-quobyte-5e3e8ac6-b47d-45b7-b697-32c335065fb7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-5e3e8ac6-b47d-45b7-b697-32c335065fb7" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65baa56-0bcc-4497-9368-9a98ace41b45]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:40 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 Sep 02 12:52:40 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:41 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:41 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7 Sep 02 12:52:41 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:41 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5e3e8ac6-b47d-45b7-b697-32c335065fb7" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "cinder-quobyte-5e3e8ac6-b47d-45b7-b697-32c335065fb7" released by "delete_volume" :: held 0.724s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Created reservations ['079ca6ae-f194-4706-bab5-604840b46b7b', 'c4ee9d1d-ca8c-4ceb-8d8c-a0e13fc86186', '9de96896-eb73-4a19-b9a6-502376d09480', '14f8b065-567c-4279-8d45-b31cd827e0cf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:41 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:41 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:41 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Deleted volume successfully. Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8c1c89a8-cdc3-48d6-a0b8-67ceb1eff6ea tempest-VolumesActionsTest-1307230054 None] Lock "cinder-5e3e8ac6-b47d-45b7-b697-32c335065fb7-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (dca07032-eb05-4c8a-8e3f-ba338d5a12e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b6a3d-62ae-49f4-ad13-50f43adbefa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334b6a3d-62ae-49f4-ad13-50f43adbefa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1515113431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efa820a-9b9d-44ef-ad89-1f345cb8160e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:42Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cd581b-39b0-436f-bf84-29eb3bffe753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cd581b-39b0-436f-bf84-29eb3bffe753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf95b48-20dc-4991-8c07-4577f0068cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf95b48-20dc-4991-8c07-4577f0068cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efa820a-9b9d-44ef-ad89-1f345cb8160e', 'volume_name': 'volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5fb85a-4d32-4364-8d29-9fb848b6b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5fb85a-4d32-4364-8d29-9fb848b6b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ed9328-af3e-4d9d-94d8-16630da945f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Volume 5efa820a-9b9d-44ef-ad89-1f345cb8160e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e', 'volume_size': 1} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1515113431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efa820a-9b9d-44ef-ad89-1f345cb8160e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:42Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Creating volume 5efa820a-9b9d-44ef-ad89-1f345cb8160e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:42 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e 1073741824 Sep 02 12:52:42 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (87af61f9-8f27-43e7-9dfa-f1dba0460875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437ad501-21ae-4918-ad11-cf695ee989a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437ad501-21ae-4918-ad11-cf695ee989a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890781806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ccc213-4c9b-4388-97ff-8c22ede1be6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:43Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ae9bcf-4321-49df-b324-0af93c4760fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ae9bcf-4321-49df-b324-0af93c4760fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a326937-1774-4133-9925-6e88c26af919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a326937-1774-4133-9925-6e88c26af919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ccc213-4c9b-4388-97ff-8c22ede1be6c', 'volume_name': 'volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f023036-83e9-4a71-8ae3-bc8c38121db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f023036-83e9-4a71-8ae3-bc8c38121db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdbff9d-820c-4a43-9a31-ee9e76aa7409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Volume 04ccc213-4c9b-4388-97ff-8c22ede1be6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c', 'volume_size': 1} Sep 02 12:52:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:43 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e 1073741824" returned: 0 in 0.691s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:43 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e Sep 02 12:52:43 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:43 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e" returned: 0 in 0.327s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890781806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ccc213-4c9b-4388-97ff-8c22ede1be6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3700fd27f9034b1698041b8fa08d3f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:43Z,use_quota=True,user_id='71ecfe356e204d13ab6ede46f5ea3355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Creating volume 04ccc213-4c9b-4388-97ff-8c22ede1be6c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:43 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c 1073741824 Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ed9328-af3e-4d9d-94d8-16630da945f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:43 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc20234-a3b6-461c-8808-3a52f02bbe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Volume volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e (5efa820a-9b9d-44ef-ad89-1f345cb8160e): created successfully Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc20234-a3b6-461c-8808-3a52f02bbe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (dca07032-eb05-4c8a-8e3f-ba338d5a12e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-302a490a-31ba-4922-8fab-66d86a4baf26 tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:52:44 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c 1073741824" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:44 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c Sep 02 12:52:44 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:44 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdbff9d-820c-4a43-9a31-ee9e76aa7409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f855e11d-c33f-4b69-bb49-1b5ab894488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Volume volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c (04ccc213-4c9b-4388-97ff-8c22ede1be6c): created successfully Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f855e11d-c33f-4b69-bb49-1b5ab894488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Flow 'volume_create_manager' (87af61f9-8f27-43e7-9dfa-f1dba0460875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c7df1a0b-53a2-42b9-a388-d3cf46f7f9f2 tempest-VolumesActionsTest-392679636 None] Created volume successfully. Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-04ccc213-4c9b-4388-97ff-8c22ede1be6c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "cinder-04ccc213-4c9b-4388-97ff-8c22ede1be6c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (50c79dde-3c7a-493a-9650-cb24baadcb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bbf173-2dc8-47ad-8697-af606aec909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bbf173-2dc8-47ad-8697-af606aec909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-71025728',display_name='tempest-VolumesGetTest-Volume-1480968061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90871832-279a-45e3-9026-6b324b431cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:45Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0acaff7-5c6f-4fd7-a2a9-ce795bc70892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0acaff7-5c6f-4fd7-a2a9-ce795bc70892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9673168-e0f7-48b4-a0e5-be61f7610fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9673168-e0f7-48b4-a0e5-be61f7610fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90871832-279a-45e3-9026-6b324b431cd8', 'volume_name': 'volume-90871832-279a-45e3-9026-6b324b431cd8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a316ea0-174e-454d-810a-97c6845615ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a316ea0-174e-454d-810a-97c6845615ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccaa3a9e-a084-45f4-8e3a-298715f4fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Volume 90871832-279a-45e3-9026-6b324b431cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90871832-279a-45e3-9026-6b324b431cd8', 'volume_size': 1} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-71025728',display_name='tempest-VolumesGetTest-Volume-1480968061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90871832-279a-45e3-9026-6b324b431cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:45Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Creating volume 90871832-279a-45e3-9026-6b324b431cd8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Acquiring lock "cinder-quobyte-04ccc213-4c9b-4388-97ff-8c22ede1be6c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "cinder-quobyte-04ccc213-4c9b-4388-97ff-8c22ede1be6c" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:45 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 1073741824 Sep 02 12:52:45 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d93c4-a0fb-4a56-9377-f12f68669487]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:45 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c Sep 02 12:52:45 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:46 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:46 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c Sep 02 12:52:46 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:46 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 1073741824" returned: 0 in 0.511s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:46 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 Sep 02 12:52:46 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:46 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-04ccc213-4c9b-4388-97ff-8c22ede1be6c" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "cinder-quobyte-04ccc213-4c9b-4388-97ff-8c22ede1be6c" released by "delete_volume" :: held 0.731s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=145,cinder:INSERT=50,cinder:UPDATE=190,cinder:DELETE=13 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:52:46 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccaa3a9e-a084-45f4-8e3a-298715f4fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90871832-279a-45e3-9026-6b324b431cd8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b1a25-cde5-4841-8025-19634c73194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Created reservations ['2c22063c-0542-46d9-b85b-5b2eb4a7cc3b', 'a06cb44e-9478-4f22-81e5-dcfa1d4fb3ca', '77a45d32-a70f-4d0b-8740-86add58d9a36', 'e0c16610-e8c0-400c-bd24-3e9e23475610'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Volume volume-90871832-279a-45e3-9026-6b324b431cd8 (90871832-279a-45e3-9026-6b324b431cd8): created successfully Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b1a25-cde5-4841-8025-19634c73194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (50c79dde-3c7a-493a-9650-cb24baadcb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a5a14b02-2f6b-4902-9d6d-3ab9f43ad282 tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:46 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:46 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:46 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Deleted volume successfully. Sep 02 12:52:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-38b236e6-e491-48d5-a7a7-0603c0f50612 tempest-VolumesActionsTest-392679636 None] Lock "cinder-04ccc213-4c9b-4388-97ff-8c22ede1be6c-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (163150a5-0a7b-4fc4-81ab-2079eb95ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aafe19-80b6-41f1-83d1-6d494404b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-90871832-279a-45e3-9026-6b324b431cd8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aafe19-80b6-41f1-83d1-6d494404b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349580164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e250c2-6852-4a3d-ac53-31b3459a013e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:48Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7f1e33-761f-400f-b23c-6c0acb39d1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7f1e33-761f-400f-b23c-6c0acb39d1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6395e20b-91d6-4c7c-8bb6-434d85f4cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6395e20b-91d6-4c7c-8bb6-434d85f4cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e250c2-6852-4a3d-ac53-31b3459a013e', 'volume_name': 'volume-86e250c2-6852-4a3d-ac53-31b3459a013e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827358d-6f42-4c4c-807d-2e1fdb023122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827358d-6f42-4c4c-807d-2e1fdb023122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bf5086-bc6c-4537-b691-f816919c5df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Volume 86e250c2-6852-4a3d-ac53-31b3459a013e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e250c2-6852-4a3d-ac53-31b3459a013e', 'volume_size': 1} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349580164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e250c2-6852-4a3d-ac53-31b3459a013e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47eb68227d432d96931aa00c9c2def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:48Z,use_quota=True,user_id='2e947334f24f4b11b789c758a00e60a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Creating volume 86e250c2-6852-4a3d-ac53-31b3459a013e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "cinder-90871832-279a-45e3-9026-6b324b431cd8-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:47 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e 1073741824 Sep 02 12:52:47 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-90871832-279a-45e3-9026-6b324b431cd8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-90871832-279a-45e3-9026-6b324b431cd8" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeadf19-ce4f-4c95-bcda-1220a2277047]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:48 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 Sep 02 12:52:48 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:48 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e 1073741824" returned: 0 in 0.656s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:48 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8" returned: 0 in 0.533s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:48 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8 Sep 02 12:52:48 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:48 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e Sep 02 12:52:48 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:48 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90871832-279a-45e3-9026-6b324b431cd8" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-90871832-279a-45e3-9026-6b324b431cd8" released by "delete_volume" :: held 0.899s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Created reservations ['0e8e5fbb-7a32-448c-966c-39077dede473', '0a0f9871-a49f-4524-8e5f-b2912d52c072', 'c7b4d380-cce2-4e73-8540-424f68586bed', '56287a68-c138-41ba-947b-2847a3c524b8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:48 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bf5086-bc6c-4537-b691-f816919c5df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e250c2-6852-4a3d-ac53-31b3459a013e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275d3626-4cfa-421e-b49d-a3204adbf86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Volume volume-86e250c2-6852-4a3d-ac53-31b3459a013e (86e250c2-6852-4a3d-ac53-31b3459a013e): created successfully Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275d3626-4cfa-421e-b49d-a3204adbf86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Flow 'volume_create_manager' (163150a5-0a7b-4fc4-81ab-2079eb95ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cee9879f-f041-4dbf-becd-9d345760272b tempest-AttachVolumeNegativeTest-1587220222 None] Created volume successfully. Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:49 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:49 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:49 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:52:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8d88edc-40a4-4fce-84f3-7fb77dee533f tempest-VolumesGetTest-654292038 None] Lock "cinder-90871832-279a-45e3-9026-6b324b431cd8-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-5efa820a-9b9d-44ef-ad89-1f345cb8160e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "cinder-5efa820a-9b9d-44ef-ad89-1f345cb8160e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-5efa820a-9b9d-44ef-ad89-1f345cb8160e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-5efa820a-9b9d-44ef-ad89-1f345cb8160e" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c657b9-f863-4ddd-98f2-ba183374466a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:50 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e Sep 02 12:52:50 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0f9ba9ee-263e-457d-b31a-8eab522bc2c7 req-6b579baf-f100-4974-b509-133be3d143a1 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0f9ba9ee-263e-457d-b31a-8eab522bc2c7 req-6b579baf-f100-4974-b509-133be3d143a1 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-0f9ba9ee-263e-457d-b31a-8eab522bc2c7 req-6b579baf-f100-4974-b509-133be3d143a1 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-0f9ba9ee-263e-457d-b31a-8eab522bc2c7 req-6b579baf-f100-4974-b509-133be3d143a1 tempest-AttachVolumeNegativeTest-1587220222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-86e250c2-6852-4a3d-ac53-31b3459a013e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1af16fc-b269-451f-96c0-8ca84819930b', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:52:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-0f9ba9ee-263e-457d-b31a-8eab522bc2c7 req-6b579baf-f100-4974-b509-133be3d143a1 tempest-AttachVolumeNegativeTest-1587220222 None] attachment_update completed successfully. Sep 02 12:52:50 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:50 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e Sep 02 12:52:50 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:51 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5efa820a-9b9d-44ef-ad89-1f345cb8160e" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-5efa820a-9b9d-44ef-ad89-1f345cb8160e" released by "delete_volume" :: held 0.960s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Created reservations ['72cfbc38-0d83-4d5e-a9c5-292abdd5e6ff', 'b5b8882b-d0f9-4791-bd01-dae29d389b78', '4884c9cd-13bd-4ade-9e0d-c4f321b9b9cb', 'bde16550-88da-4123-834a-a5b5a5e67a03'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:51 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:52:51 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:51 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:52:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:52:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e64f88-2fa2-4398-9280-45fa5d4debcc tempest-VolumesGetTest-654292038 None] Lock "cinder-5efa820a-9b9d-44ef-ad89-1f345cb8160e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:52:52 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (5673e046-5c73-4428-ad23-0e9bca7f937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef444cc1-ac10-4415-a8c7-e686b8647858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef444cc1-ac10-4415-a8c7-e686b8647858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845124054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270b4e31-ff59-4f54-8162-61a5384b8ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:53Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dce26f-97e4-4167-9f2a-56c378ba5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dce26f-97e4-4167-9f2a-56c378ba5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15243b9e-9a59-485d-96fe-189ffae3c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15243b9e-9a59-485d-96fe-189ffae3c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270b4e31-ff59-4f54-8162-61a5384b8ae7', 'volume_name': 'volume-270b4e31-ff59-4f54-8162-61a5384b8ae7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6cab25-44e2-45f8-a528-f3b5ee15e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6cab25-44e2-45f8-a528-f3b5ee15e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d2e16-e7df-483e-a2d6-0b2b88eb7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Volume 270b4e31-ff59-4f54-8162-61a5384b8ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270b4e31-ff59-4f54-8162-61a5384b8ae7', 'volume_size': 1} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845124054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270b4e31-ff59-4f54-8162-61a5384b8ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:53Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Creating volume 270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:52:53 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:53 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 1073741824 Sep 02 12:52:53 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:53 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 1073741824" returned: 0 in 0.602s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-3976c290-75c7-44a3-bbb5-991245e7d3e5 req-e226bdc2-f8db-4d8b-ac29-bb5e190554c7 tempest-AttachVolumeNegativeTest-1587220222 None] Terminate volume connection completed successfully. Sep 02 12:52:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-3976c290-75c7-44a3-bbb5-991245e7d3e5 req-e226bdc2-f8db-4d8b-ac29-bb5e190554c7 tempest-AttachVolumeNegativeTest-1587220222 None] Deleting attachment e1af16fc-b269-451f-96c0-8ca84819930b. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:52:53 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:52:53 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:54 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d2e16-e7df-483e-a2d6-0b2b88eb7c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270b4e31-ff59-4f54-8162-61a5384b8ae7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ebbf58-58ad-4a44-8516-7f5d6ef40324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Volume volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 (270b4e31-ff59-4f54-8162-61a5384b8ae7): created successfully Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ebbf58-58ad-4a44-8516-7f5d6ef40324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (5673e046-5c73-4428-ad23-0e9bca7f937c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-05df7992-af02-4191-ad48-a776879574ec tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (fbd9c0f6-4471-4df2-83a0-aa27765c611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8d4e32-ac94-4f8f-9124-c4c5ed3c061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8d4e32-ac94-4f8f-9124-c4c5ed3c061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1427158944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b4caad-f15d-4672-95e4-f64d10fc1e8f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=270b4e31-ff59-4f54-8162-61a5384b8ae7,status='creating',terminated_at=None,updated_at=2026-09-02T10:52:56Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e8a9e4-4495-4551-b257-f1a94b40eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e8a9e4-4495-4551-b257-f1a94b40eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48d5524-9dd1-4ab6-a7d5-97b222a5e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48d5524-9dd1-4ab6-a7d5-97b222a5e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '67b4caad-f15d-4672-95e4-f64d10fc1e8f', 'volume_name': 'volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f', 'volume_size': 1, 'source_volid': '270b4e31-ff59-4f54-8162-61a5384b8ae7', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830e1d7a-84f8-4025-95a2-88390033a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830e1d7a-84f8-4025-95a2-88390033a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87df27-bff4-488e-9e2a-3f27e875e5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:52:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Volume 67b4caad-f15d-4672-95e4-f64d10fc1e8f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f', 'volume_size': 1, 'source_volid': '270b4e31-ff59-4f54-8162-61a5384b8ae7', 'source_volstatus': 'available'} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Cloning volume 270b4e31-ff59-4f54-8162-61a5384b8ae7 to volume 67b4caad-f15d-4672-95e4-f64d10fc1e8f Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Creating offline snapshot ae7e87d8-e4a4-4ad5-9512-0957c79812a9 of volume 270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3464a-1213-4bbf-bc9f-bf9c91cfb68e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:56 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:52:56 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:56 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:56 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 1G Sep 02 12:52:56 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:57 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 1G" returned: 0 in 0.752s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:57 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:52:57 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:57 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:57 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 is being set with open permissions: ugo+rw Sep 02 12:52:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:57 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:52:57 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:57 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:58 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info Sep 02 12:52:58 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:58 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:58 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info is being set with open permissions: ugo+rw Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:58 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info Sep 02 12:52:58 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:58 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.info" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] snapshot: ae7e87d8-e4a4-4ad5-9512-0957c79812a9, volume: 67b4caad-f15d-4672-95e4-f64d10fc1e8f, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[34964f1a-ded0-488d-8907-44fa882a0481]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:59 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:52:59 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-86e250c2-6852-4a3d-ac53-31b3459a013e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:59 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.572s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270b4e31-ff59-4f54-8162-61a5384b8ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-86e250c2-6852-4a3d-ac53-31b3459a013e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[52186249-e353-4465-888d-75a70fd38e1c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-quobyte-86e250c2-6852-4a3d-ac53-31b3459a013e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-86e250c2-6852-4a3d-ac53-31b3459a013e" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc84ed-f0ab-489b-964f-b215d7ed0f7f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:59 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:52:59 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:59 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e Sep 02 12:52:59 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:59 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:52:59 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f Sep 02 12:52:59 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:52:59 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:52:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:00 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e Sep 02 12:53:00 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:00 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86e250c2-6852-4a3d-ac53-31b3459a013e" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-86e250c2-6852-4a3d-ac53-31b3459a013e" released by "delete_volume" :: held 0.784s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Created reservations ['6011a44e-b662-4215-8e2d-225dc38aba79', 'a0a61b27-9bd8-4d1f-a710-a29b9770daad', 'af22b08b-26ce-4536-b230-7b66d81a0d35', '2e2cc99d-7ef6-4592-9353-ce42b1a2b96a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:00 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:00 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-quobyte-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:01 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.785s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Deleted volume successfully. Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" acquired by "delete_volume" :: waited 0.067s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-73d43203-27ce-4d20-8a5f-a58e3e7fb3d4 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-86e250c2-6852-4a3d-ac53-31b3459a013e-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1593a9b-87cd-4a98-bea6-98b4b2f51695]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:01 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a Sep 02 12:53:01 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:02 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" returned: 0 in 0.650s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:02 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a Sep 02 12:53:02 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:02 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" returned: 0 in 0.712s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a" released by "delete_volume" :: held 1.528s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:02 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=142,cinder:INSERT=39,cinder:UPDATE=178,cinder:DELETE=15 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Created reservations ['6cb607f7-e73e-48cc-91f9-38c2613b22b4', '4eb50473-1b77-4e21-9ac9-5469590a2fa0', 'c934aed9-32ec-43e3-96fd-46c4a81c5276', '44f5c5ef-aa64-42a3-a4bb-23d7f68fda21'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:03 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:03 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:03 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.692s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Deleted volume successfully. Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54fb0383-9956-48da-b10c-8e64ded8ba9b tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-ebfbaea7-946c-4e52-b84b-23fc6ea36f9a-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-811dc9ee-d723-4612-9f16-b6d5d8544e83-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-811dc9ee-d723-4612-9f16-b6d5d8544e83-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "cinder-quobyte-811dc9ee-d723-4612-9f16-b6d5d8544e83" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-811dc9ee-d723-4612-9f16-b6d5d8544e83" acquired by "delete_volume" :: waited 0.053s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7abc4-a307-4553-b639-4a3cc1c92afa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:04 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:04 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Flow 'volume_create_manager' (d368400c-895d-42fe-b5bd-8d90b599a962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529dadcd-ca8b-4e06-8b0e-77e65cb71aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529dadcd-ca8b-4e06-8b0e-77e65cb71aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1009976164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cdd63d-d783-4c05-8921-d076785b4289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34058161d734dbfae83c4bb6bbc4a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:05Z,use_quota=True,user_id='e5b8f4462f92446c9ba8cba58b309d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27d132d-be11-48ba-a224-0a8dc6d8203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27d132d-be11-48ba-a224-0a8dc6d8203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f209711-67e4-48dc-a9bc-301d6fdd0a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f209711-67e4-48dc-a9bc-301d6fdd0a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cdd63d-d783-4c05-8921-d076785b4289', 'volume_name': 'volume-e9cdd63d-d783-4c05-8921-d076785b4289', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0402bf7-9d12-43ca-b2c7-3cc2e6798c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0402bf7-9d12-43ca-b2c7-3cc2e6798c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594895b-28fb-4f52-92e2-1cf6bdea7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Volume e9cdd63d-d783-4c05-8921-d076785b4289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cdd63d-d783-4c05-8921-d076785b4289', 'volume_size': 1} Sep 02 12:53:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:05 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83" returned: 0 in 1.081s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:05 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83 Sep 02 12:53:05 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:06 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:06 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-811dc9ee-d723-4612-9f16-b6d5d8544e83" returned: 0 in 0.633s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f" returned: 0 in 6.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:53:06 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Converted 1024.00 MB image at 162.15 MB/s Sep 02 12:53:06 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f is being set with open permissions: ugo+rw Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-quobyte-811dc9ee-d723-4612-9f16-b6d5d8544e83" released by "delete_volume" :: held 1.834s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:06 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f Sep 02 12:53:06 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Created reservations ['55057ae0-e96e-4f97-8e8c-99764c231fbf', '1f7ceb04-c268-4878-880c-2c0f93fe125b', 'a187bfdb-5b87-4a27-92de-2ec4a6ccdf79', 'c1a9b08e-652f-4027-8a5d-a99e94031df9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:06 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:06 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:06 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" released by "_copy_volume_from_snapshot" :: held 7.689s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-ae7e87d8-e4a4-4ad5-9512-0957c79812a9" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-ae7e87d8-e4a4-4ad5-9512-0957c79812a9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Deleting offline snapshot ae7e87d8-e4a4-4ad5-9512-0957c79812a9 of volume 270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] snapshot_file for this snap is: volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bcb64-0f1d-4819-89f7-f8855fe6ba12]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:06 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Deleted volume successfully. Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-736e4d92-4166-4f4d-b2d5-782bd5217af5 tempest-AttachVolumeNegativeTest-1587220222 None] Lock "cinder-811dc9ee-d723-4612-9f16-b6d5d8544e83-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:06 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:53:06 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:06 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270b4e31-ff59-4f54-8162-61a5384b8ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[25df2bb6-6fb4-4f97-96c7-d82613d24327]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:07 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:53:07 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:07 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.631s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:07 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:53:07 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Flow 'volume_create_manager' (c953c9fc-a335-4297-a778-b9b0b6f94dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5288e71a-50a8-402d-ae72-6f7deab10af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5288e71a-50a8-402d-ae72-6f7deab10af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1569044953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0a457a-abe4-4992-8c31-c706d49dac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31743a29cf94d08a2815a8ec87bcb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:08Z,use_quota=True,user_id='ef8a4909455f4d3088668bdcd1c60469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffc227a-9ba2-4b33-a54c-6d4c88067130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffc227a-9ba2-4b33-a54c-6d4c88067130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a076a-1866-487e-a1f1-ed062f563e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a076a-1866-487e-a1f1-ed062f563e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0a457a-abe4-4992-8c31-c706d49dac53', 'volume_name': 'volume-8b0a457a-abe4-4992-8c31-c706d49dac53', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eada70c-9cb9-4cc6-b948-9772d2fed984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eada70c-9cb9-4cc6-b948-9772d2fed984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f993887-4531-4c4f-b9b5-ed5f84b58147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Volume 8b0a457a-abe4-4992-8c31-c706d49dac53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0a457a-abe4-4992-8c31-c706d49dac53', 'volume_size': 1} Sep 02 12:53:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:08 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:08 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9 Sep 02 12:53:08 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:08 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7.ae7e87d8-e4a4-4ad5-9512-0957c79812a9" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-ae7e87d8-e4a4-4ad5-9512-0957c79812a9" released by "_delete_snapshot" :: held 1.828s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.313s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.504s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1009976164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cdd63d-d783-4c05-8921-d076785b4289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34058161d734dbfae83c4bb6bbc4a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:05Z,use_quota=True,user_id='e5b8f4462f92446c9ba8cba58b309d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Creating volume e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:08 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 1073741824 Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87df27-bff4-488e-9e2a-3f27e875e5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f', 'volume_size': 1, 'source_volid': '270b4e31-ff59-4f54-8162-61a5384b8ae7', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:08 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac271c7f-b856-4bba-9052-55c3e4a08188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Volume volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f (67b4caad-f15d-4672-95e4-f64d10fc1e8f): created successfully Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac271c7f-b856-4bba-9052-55c3e4a08188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (fbd9c0f6-4471-4df2-83a0-aa27765c611e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9f009b52-4de8-48db-9864-7fc410136ee0 tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:53:08 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 1073741824" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:08 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 Sep 02 12:53:08 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:09 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1569044953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0a457a-abe4-4992-8c31-c706d49dac53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31743a29cf94d08a2815a8ec87bcb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:08Z,use_quota=True,user_id='ef8a4909455f4d3088668bdcd1c60469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Creating volume 8b0a457a-abe4-4992-8c31-c706d49dac53 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:09 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594895b-28fb-4f52-92e2-1cf6bdea7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cdd63d-d783-4c05-8921-d076785b4289', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8977003-5367-4c47-a540-847d8c05eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:09 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 1073741824 Sep 02 12:53:09 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Volume volume-e9cdd63d-d783-4c05-8921-d076785b4289 (e9cdd63d-d783-4c05-8921-d076785b4289): created successfully Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8977003-5367-4c47-a540-847d8c05eb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Flow 'volume_create_manager' (d368400c-895d-42fe-b5bd-8d90b599a962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1c433168-747c-4da5-a96a-5a6e58ec5926 tempest-SnapshotMetadataTestJSON-771248755 None] Created volume successfully. Sep 02 12:53:09 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 1073741824" returned: 0 in 0.478s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:09 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 Sep 02 12:53:09 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:10 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f993887-4531-4c4f-b9b5-ed5f84b58147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0a457a-abe4-4992-8c31-c706d49dac53', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec592ee-454b-4d7d-a7b9-8c43f406b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Volume volume-8b0a457a-abe4-4992-8c31-c706d49dac53 (8b0a457a-abe4-4992-8c31-c706d49dac53): created successfully Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec592ee-454b-4d7d-a7b9-8c43f406b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Flow 'volume_create_manager' (c953c9fc-a335-4297-a778-b9b0b6f94dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-12ad0192-ec4c-447b-b825-f2dbc664bd08 tempest-AbsoluteLimitsTests-359179672 None] Created volume successfully. Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (e4300749-e736-4cb7-a33a-f79b18676369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80dd85a-0c72-4a68-b07b-1c0e5ea345e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80dd85a-0c72-4a68-b07b-1c0e5ea345e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658145905',display_name='tempest-VolumesGetTest-Volume-636695692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce462144-8f19-424e-b51b-ba637a59b5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:10Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea099de-7fa8-474c-aab5-11cf2c3afd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea099de-7fa8-474c-aab5-11cf2c3afd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570f4a09-ea1e-4638-ad91-bc6f89aea9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570f4a09-ea1e-4638-ad91-bc6f89aea9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce462144-8f19-424e-b51b-ba637a59b5bb', 'volume_name': 'volume-ce462144-8f19-424e-b51b-ba637a59b5bb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4742cf4-550e-4f5b-8221-000b3a3503bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4742cf4-550e-4f5b-8221-000b3a3503bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7f9b5f-f955-44d1-adbc-8dea86d2ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Volume ce462144-8f19-424e-b51b-ba637a59b5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce462144-8f19-424e-b51b-ba637a59b5bb', 'volume_size': 1} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658145905',display_name='tempest-VolumesGetTest-Volume-636695692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce462144-8f19-424e-b51b-ba637a59b5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:10Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Creating volume ce462144-8f19-424e-b51b-ba637a59b5bb {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:10 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb 1073741824 Sep 02 12:53:10 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:10 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb 1073741824" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:10 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb Sep 02 12:53:10 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Acquiring lock "cinder-8b0a457a-abe4-4992-8c31-c706d49dac53-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "cinder-8b0a457a-abe4-4992-8c31-c706d49dac53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Acquiring lock "cinder-quobyte-8b0a457a-abe4-4992-8c31-c706d49dac53" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "cinder-quobyte-8b0a457a-abe4-4992-8c31-c706d49dac53" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b56c97-d7b1-4b4a-9eef-163ab41d8ea6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:11 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.771s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7f9b5f-f955-44d1-adbc-8dea86d2ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce462144-8f19-424e-b51b-ba637a59b5bb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018a00d8-5cb3-4e43-88d3-7d35788e3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Creating offline snapshot 36464653-cd70-47c8-b6d8-b5be335fa4ce of volume e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:53:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Volume volume-ce462144-8f19-424e-b51b-ba637a59b5bb (ce462144-8f19-424e-b51b-ba637a59b5bb): created successfully Sep 02 12:53:11 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 Sep 02 12:53:11 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018a00d8-5cb3-4e43-88d3-7d35788e3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (e4300749-e736-4cb7-a33a-f79b18676369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c472b8-bf5c-4323-9c15-65ab78d9b82a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c8a8d1d6-9d35-4fa7-868f-35826f82c38d tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:53:11 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 Sep 02 12:53:11 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:11 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:11 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53 Sep 02 12:53:11 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:11 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:11 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce 1G Sep 02 12:53:11 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:11 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8b0a457a-abe4-4992-8c31-c706d49dac53" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "cinder-quobyte-8b0a457a-abe4-4992-8c31-c706d49dac53" released by "delete_volume" :: held 0.816s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Created reservations ['1c3d0f51-99c0-491c-9b8a-8f68a01ff374', '19fba45d-eab9-42d0-947f-1df49e02ac6c', '7b77b2af-4af6-4bae-9215-71f75ce2fbb7', '6c4f9c2d-0df3-4898-a1ac-7c9c1044442e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:12 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:12 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:12 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce 1G" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cdd63d-d783-4c05-8921-d076785b4289 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:12 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:12 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cdd63d-d783-4c05-8921-d076785b4289 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:12 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Deleted volume successfully. Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ebe9d7b-42c9-49ba-b5a9-4ef93c0cbac0 tempest-AbsoluteLimitsTests-359179672 None] Lock "cinder-8b0a457a-abe4-4992-8c31-c706d49dac53-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-ce462144-8f19-424e-b51b-ba637a59b5bb-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "cinder-ce462144-8f19-424e-b51b-ba637a59b5bb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-ce462144-8f19-424e-b51b-ba637a59b5bb" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-ce462144-8f19-424e-b51b-ba637a59b5bb" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d231a9f-d886-40c6-8fb2-101a45c87563]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:12 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cdd63d-d783-4c05-8921-d076785b4289 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce is being set with open permissions: ugo+rw Sep 02 12:53:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:12 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb Sep 02 12:53:12 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:12 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce Sep 02 12:53:12 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:13 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:13 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:13 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info Sep 02 12:53:13 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:13 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb Sep 02 12:53:13 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:13 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce462144-8f19-424e-b51b-ba637a59b5bb" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-ce462144-8f19-424e-b51b-ba637a59b5bb" released by "delete_volume" :: held 0.805s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:13 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info" returned: 0 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info is being set with open permissions: ugo+rw Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:13 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info Sep 02 12:53:13 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Created reservations ['f3d456d9-701b-4bfb-96d4-87348570a29a', 'a598afa1-8870-43a8-8849-b82809c574f2', '04801b3e-f6b5-4a08-85d2-056f53a8ba19', '1c8f89eb-adfc-4f32-aab2-f60bc7a84a3b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:13 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:13 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-67b4caad-f15d-4672-95e4-f64d10fc1e8f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "cinder-67b4caad-f15d-4672-95e4-f64d10fc1e8f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:13 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.info" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ada1b2b2-76c7-41a5-b3cd-a0fd506e4035 tempest-SnapshotMetadataTestJSON-771248755 None] Create snapshot completed successfully Sep 02 12:53:13 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5dc5f-9fd3-4017-9a12-e75f961e048f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-744fa649-0d4a-4371-a5f8-7174a4c6a672 tempest-VolumesGetTest-654292038 None] Lock "cinder-ce462144-8f19-424e-b51b-ba637a59b5bb-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:14 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f Sep 02 12:53:14 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:14 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:14 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f Sep 02 12:53:14 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:14 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-67b4caad-f15d-4672-95e4-f64d10fc1e8f" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-67b4caad-f15d-4672-95e4-f64d10fc1e8f" released by "delete_volume" :: held 0.812s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Created reservations ['c918f615-5c34-4799-8c4f-9c75265e96a7', '26de1b8d-6be3-4b0e-a6ef-af78a9a63f7a', 'c610262f-afe7-4348-b7b3-74cdd7e44706', '67759147-3ea4-4d64-b735-2cff30dcc3a9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:14 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:14 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-270b4e31-ff59-4f54-8162-61a5384b8ae7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "cinder-270b4e31-ff59-4f54-8162-61a5384b8ae7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-270b4e31-ff59-4f54-8162-61a5384b8ae7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-270b4e31-ff59-4f54-8162-61a5384b8ae7" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:15 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac867e6-a877-4e5c-aa94-80bf979d8bfb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ce5811d-cc1e-465c-906d-05dfbcd09f78 tempest-VolumesGetTest-654292038 None] Lock "cinder-67b4caad-f15d-4672-95e4-f64d10fc1e8f-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:15 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:53:15 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "cinder-36464653-cd70-47c8-b6d8-b5be335fa4ce-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-36464653-cd70-47c8-b6d8-b5be335fa4ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "cinder-quobyte-36464653-cd70-47c8-b6d8-b5be335fa4ce" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-36464653-cd70-47c8-b6d8-b5be335fa4ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Deleting offline snapshot 36464653-cd70-47c8-b6d8-b5be335fa4ce of volume e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:53:15 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] snapshot_file for this snap is: volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.525s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff10826b-5b33-4553-9980-47bdd94105a6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:15 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7 Sep 02 12:53:15 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:16 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce Sep 02 12:53:16 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:16 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-270b4e31-ff59-4f54-8162-61a5384b8ae7" returned: 0 in 0.332s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-270b4e31-ff59-4f54-8162-61a5384b8ae7" released by "delete_volume" :: held 0.994s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (4778e4a7-d23f-48dc-89e5-815236dff307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab291bdf-c2b8-48fc-ad7c-bceae801082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab291bdf-c2b8-48fc-ad7c-bceae801082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-483624225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a6158-8adf-4a3c-9b15-0f072abd2051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:16Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79041d53-bf1d-43dd-a331-e54643a278fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79041d53-bf1d-43dd-a331-e54643a278fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:16 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d9845-375a-4097-96ef-ad7480a1f205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d9845-375a-4097-96ef-ad7480a1f205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19a6158-8adf-4a3c-9b15-0f072abd2051', 'volume_name': 'volume-f19a6158-8adf-4a3c-9b15-0f072abd2051', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1527e4e9-4496-42c3-af07-02cd6fe4a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1527e4e9-4496-42c3-af07-02cd6fe4a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd444706-3310-4704-950f-9604a9a3e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Volume f19a6158-8adf-4a3c-9b15-0f072abd2051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19a6158-8adf-4a3c-9b15-0f072abd2051', 'volume_size': 1} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-483624225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a6158-8adf-4a3c-9b15-0f072abd2051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:16Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Creating volume f19a6158-8adf-4a3c-9b15-0f072abd2051 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Created reservations ['9e973a6c-57eb-4277-8d2d-ba019c57351b', '75850b1f-9af8-46e5-9a43-14874bfd08d8', 'fb00d860-ce2a-4851-99af-51a78008857e', 'e3a976dd-0899-4834-af3d-38d77bb747b6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce" returned: 0 in 0.589s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9cdd63d-d783-4c05-8921-d076785b4289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:53:16 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 1073741824 Sep 02 12:53:16 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27bd2a-8446-4159-ac94-e0b63698a36e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:16 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 Sep 02 12:53:16 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:16 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:16 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:16 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:53:16 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a4ef7e42-f0b5-4df1-ae98-a96fbdda0055 tempest-VolumesGetTest-654292038 None] Lock "cinder-270b4e31-ff59-4f54-8162-61a5384b8ae7-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:17 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:17 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce Sep 02 12:53:17 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 1073741824" returned: 0 in 0.537s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:17 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 Sep 02 12:53:17 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:17 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:17 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd444706-3310-4704-950f-9604a9a3e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19a6158-8adf-4a3c-9b15-0f072abd2051', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff9da19-9bb9-4bfe-80ab-a4e671809e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:17 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce Sep 02 12:53:17 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Volume volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 (f19a6158-8adf-4a3c-9b15-0f072abd2051): created successfully Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff9da19-9bb9-4bfe-80ab-a4e671809e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (4778e4a7-d23f-48dc-89e5-815236dff307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5c995474-2512-4cc8-8f68-377c32af3630 tempest-VolumesTestJSON-891292887 None] Created volume successfully. Sep 02 12:53:17 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289.36464653-cd70-47c8-b6d8-b5be335fa4ce" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-36464653-cd70-47c8-b6d8-b5be335fa4ce" released by "_delete_snapshot" :: held 1.890s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" released by "delete_snapshot" :: held 1.925s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Flow 'volume_create_manager' (56cf0aaa-916f-4f4b-91d0-fdb5074dbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dd23e2-dc8a-48d1-b549-efc502479407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dd23e2-dc8a-48d1-b549-efc502479407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1571216825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403c4954-9350-4fcb-87f8-90d1b2fa99dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa40baba09c64175ab50775f49e7a2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:18Z,use_quota=True,user_id='c54152febe5f46d8a581b1f14ca102a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88852c9-dd28-49dd-8013-982dd1b811be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88852c9-dd28-49dd-8013-982dd1b811be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecee3ad0-f2a2-4f1d-94f9-ee9bfdcb8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecee3ad0-f2a2-4f1d-94f9-ee9bfdcb8df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403c4954-9350-4fcb-87f8-90d1b2fa99dc', 'volume_name': 'volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a70a9e-adf7-4e7a-935b-69cd9a37e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a70a9e-adf7-4e7a-935b-69cd9a37e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7f9627-b128-4c4b-8fb8-16c965be8513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Volume 403c4954-9350-4fcb-87f8-90d1b2fa99dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc', 'volume_size': 2} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1571216825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403c4954-9350-4fcb-87f8-90d1b2fa99dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa40baba09c64175ab50775f49e7a2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:18Z,use_quota=True,user_id='c54152febe5f46d8a581b1f14ca102a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Creating volume 403c4954-9350-4fcb-87f8-90d1b2fa99dc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc 2147483648 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:17 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc 2147483648 Sep 02 12:53:17 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Created reservations ['7b09bb5c-3888-4a2a-8b82-fc0cca2fdc0e', 'bb11c656-8e50-44e7-8d31-d7d1de39eb5c', 'e6f11e63-31e5-4e40-bc36-40dc65c52824', '9c13cd12-01ca-494f-a615-d1eb0201f8ea'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Delete snapshot completed successfully. Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9dcf8f40-a08d-4e47-93c8-000adb7aad78 tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-36464653-cd70-47c8-b6d8-b5be335fa4ce-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (a671bf74-f0cf-4ab5-8727-9779ca80a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c6e06-bb8d-4b13-b1a9-a72700281d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c6e06-bb8d-4b13-b1a9-a72700281d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1590373835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e94714-1650-421b-a71c-b9dae6acab27,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:18Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5832ebd-486a-4120-be67-0ce4aa353ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5832ebd-486a-4120-be67-0ce4aa353ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed61bb-a0c6-47c6-bf01-6efb1edfbbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:53:18 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc 2147483648" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:18 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc Sep 02 12:53:18 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed61bb-a0c6-47c6-bf01-6efb1edfbbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72e94714-1650-421b-a71c-b9dae6acab27', 'volume_name': 'volume-72e94714-1650-421b-a71c-b9dae6acab27', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da694eb1-d563-4a0a-a41d-ea5bb42704dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da694eb1-d563-4a0a-a41d-ea5bb42704dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d8615-3e4e-496c-abca-dfc8766cef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Volume 72e94714-1650-421b-a71c-b9dae6acab27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72e94714-1650-421b-a71c-b9dae6acab27', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Trying to clone 72e94714-1650-421b-a71c-b9dae6acab27 from image 522e45ed-34d8-4082-932f-8d27db1e62a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:53:18 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7f9627-b128-4c4b-8fb8-16c965be8513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6686e8e-a297-4a45-a37c-da873421211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Volume volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc (403c4954-9350-4fcb-87f8-90d1b2fa99dc): created successfully Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6686e8e-a297-4a45-a37c-da873421211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Flow 'volume_create_manager' (56cf0aaa-916f-4f4b-91d0-fdb5074dbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0e9140a4-1f96-4b79-9105-9d1630764e7f tempest-VolumesCloneNegativeTest-164282119 None] Created volume successfully. Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "cinder-e9cdd63d-d783-4c05-8921-d076785b4289-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (7ad3e2d7-6b04-45ad-89db-4c51d7dd4d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14930e87-0959-4bbe-8ef4-2b52c3a2954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:53:19 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Image download 20.69 MB at 20.69 MB/s Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-e9cdd63d-d783-4c05-8921-d076785b4289-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14930e87-0959-4bbe-8ef4-2b52c3a2954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1284987582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e0f3dd-06ec-401b-99af-827af6dddce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:19Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd20d52b-4db3-4313-8f49-6d07c28d70a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd20d52b-4db3-4313-8f49-6d07c28d70a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658512f-8b66-4968-9be6-745e6bebdfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658512f-8b66-4968-9be6-745e6bebdfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e0f3dd-06ec-401b-99af-827af6dddce7', 'volume_name': 'volume-14e0f3dd-06ec-401b-99af-827af6dddce7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef889c57-181f-46e1-880f-e884f05278f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef889c57-181f-46e1-880f-e884f05278f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce50d4-e419-48b1-84cf-aaeeba1199cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Volume 14e0f3dd-06ec-401b-99af-827af6dddce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e0f3dd-06ec-401b-99af-827af6dddce7', 'volume_size': 1} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1284987582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e0f3dd-06ec-401b-99af-827af6dddce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:19Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Creating volume 14e0f3dd-06ec-401b-99af-827af6dddce7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 1073741824 Sep 02 12:53:19 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a6f73-59c4-40a9-928d-3347eb5f0180]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6698f4c-d8b4-4bb9-a9a8-3a63c3cfc928]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD Sep 02 12:53:19 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:19 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 Sep 02 12:53:19 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:19 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 is fetched for user f4f4e8c42cf849d2ab8e4140b95f9320. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:53:19 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 1073741824" returned: 0 in 0.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98ceee-6afc-4d13-a6eb-0d0b24416b1c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:19 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 Sep 02 12:53:19 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:19 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289 Sep 02 12:53:19 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:19 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD Sep 02 12:53:19 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Acquiring lock "cinder-403c4954-9350-4fcb-87f8-90d1b2fa99dc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "cinder-403c4954-9350-4fcb-87f8-90d1b2fa99dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:20 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Acquiring lock "cinder-quobyte-403c4954-9350-4fcb-87f8-90d1b2fa99dc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e9cdd63d-d783-4c05-8921-d076785b4289" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-quobyte-e9cdd63d-d783-4c05-8921-d076785b4289" released by "delete_volume" :: held 0.802s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "cinder-quobyte-403c4954-9350-4fcb-87f8-90d1b2fa99dc" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e2c1b-7741-48cf-bde4-3a9930a74a42]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:20 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1590373835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e94714-1650-421b-a71c-b9dae6acab27,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:18Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Creating volume 72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:20 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:20 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1073741824 Sep 02 12:53:20 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce50d4-e419-48b1-84cf-aaeeba1199cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e0f3dd-06ec-401b-99af-827af6dddce7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42be6e8-fafe-4fea-b841-edfbb8a311a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Volume volume-14e0f3dd-06ec-401b-99af-827af6dddce7 (14e0f3dd-06ec-401b-99af-827af6dddce7): created successfully Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42be6e8-fafe-4fea-b841-edfbb8a311a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (7ad3e2d7-6b04-45ad-89db-4c51d7dd4d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-766b32b7-9785-4fe5-820a-f064889ce25d tempest-VolumesTestJSON-891292887 None] Created volume successfully. Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Created reservations ['f43356c8-4a90-4f4f-acc3-1baed5b6ee08', '87859d25-080c-4536-af1e-8b14667de531', '90285bac-636f-4ce1-a062-35986c75ec75', '3432b9d5-8360-4df2-b141-708226a4700d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:20 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc Sep 02 12:53:20 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:20 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:20 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:20 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc Sep 02 12:53:20 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Deleted volume successfully. Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4ab6d152-f7ee-41c0-9c13-63659c2d7c1a tempest-SnapshotMetadataTestJSON-771248755 None] Lock "cinder-e9cdd63d-d783-4c05-8921-d076785b4289-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:20 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1073741824" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:20 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 Sep 02 12:53:20 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:20 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-403c4954-9350-4fcb-87f8-90d1b2fa99dc" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "cinder-quobyte-403c4954-9350-4fcb-87f8-90d1b2fa99dc" released by "delete_volume" :: held 0.738s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Created reservations ['975e63b7-b915-449c-a71f-671cdb41c3b8', '9a3f4f4d-bf2f-4190-a8ba-df36545f2d75', '5d8bbe57-2e03-49dc-8ae6-cb621c592c82', 'bff10b6c-f58b-4884-bf6f-64281908c296'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:21 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:21 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:21 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Attempting download of 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 72e94714-1650-421b-a71c-b9dae6acab27. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e0652-b870-420f-93ea-4896ea9c7cda]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:21 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct Sep 02 12:53:21 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:21 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Deleted volume successfully. Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-76f16bb8-64ef-4708-a8ef-55fd2d0d1ece tempest-VolumesCloneNegativeTest-164282119 None] Lock "cinder-403c4954-9350-4fcb-87f8-90d1b2fa99dc-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:21 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:21 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct Sep 02 12:53:21 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (1e27535d-24e9-437a-b8c5-7893b166e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c53d27-5b5e-44c5-b8c1-25cbc6c35c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c53d27-5b5e-44c5-b8c1-25cbc6c35c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1266114202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd59abab-9fde-4b61-8286-0770ca218f86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:22Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a9af6f-6037-4ce7-b074-31269fd288a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a9af6f-6037-4ce7-b074-31269fd288a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770023bc-26bf-45f5-aa28-c2a9e1fcaee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770023bc-26bf-45f5-aa28-c2a9e1fcaee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd59abab-9fde-4b61-8286-0770ca218f86', 'volume_name': 'volume-cd59abab-9fde-4b61-8286-0770ca218f86', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc90e4f-c937-4e77-a6ac-e9a5ebc3b55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc90e4f-c937-4e77-a6ac-e9a5ebc3b55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46d7a0-f4af-4ca8-bb0f-70151b5ec4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Volume cd59abab-9fde-4b61-8286-0770ca218f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd59abab-9fde-4b61-8286-0770ca218f86', 'volume_size': 1} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1266114202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd59abab-9fde-4b61-8286-0770ca218f86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce43821b25e441b295ea75c5265afda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:22Z,use_quota=True,user_id='cfad167c0766468da95d4395482b4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Creating volume cd59abab-9fde-4b61-8286-0770ca218f86 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:22 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 1073741824 Sep 02 12:53:22 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:22 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct" returned: 1 in 0.475s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_uvohkcct' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c820fdf-1267-4848-b524-47f60dd87dae]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:22 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD Sep 02 12:53:22 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:22 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] 522e45ed-34d8-4082-932f-8d27db1e62a2 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:22 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 Sep 02 12:53:22 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:22 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 1073741824" returned: 0 in 0.641s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:22 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 Sep 02 12:53:22 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:23 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46d7a0-f4af-4ca8-bb0f-70151b5ec4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd59abab-9fde-4b61-8286-0770ca218f86', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff8402d-f1a9-44de-913a-7b41897562ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Volume volume-cd59abab-9fde-4b61-8286-0770ca218f86 (cd59abab-9fde-4b61-8286-0770ca218f86): created successfully Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff8402d-f1a9-44de-913a-7b41897562ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Flow 'volume_create_manager' (1e27535d-24e9-437a-b8c5-7893b166e92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-78322b1c-fbb9-4155-b584-787714b9a37f tempest-VolumesTestJSON-891292887 None] Created volume successfully. Sep 02 12:53:24 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27" returned: 0 in 2.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_amklsikjdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:53:24 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Converted 112.00 MB image at 49.12 MB/s Sep 02 12:53:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:24 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1G Sep 02 12:53:24 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:25 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 1G" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Downloaded image 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 72e94714-1650-421b-a71c-b9dae6acab27 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 for user f4f4e8c42cf849d2ab8e4140b95f9320 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Marking volume 72e94714-1650-421b-a71c-b9dae6acab27 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Copying metadata from image 522e45ed-34d8-4082-932f-8d27db1e62a2 to 72e94714-1650-421b-a71c-b9dae6acab27. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Creating volume glance metadata for volume 72e94714-1650-421b-a71c-b9dae6acab27 backed by image 522e45ed-34d8-4082-932f-8d27db1e62a2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-cd59abab-9fde-4b61-8286-0770ca218f86-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "cinder-cd59abab-9fde-4b61-8286-0770ca218f86-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-quobyte-cd59abab-9fde-4b61-8286-0770ca218f86" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d8615-3e4e-496c-abca-dfc8766cef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e94714-1650-421b-a71c-b9dae6acab27', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9cbfa8-6448-48ed-af46-6ee5f1f6443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-cd59abab-9fde-4b61-8286-0770ca218f86" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Flow 'volume_create_manager' (d6f9b0c7-75c0-44a3-9e90-44b9cbdd341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af01a8ca-8302-419f-9f85-4c8c9bdff7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a8487-f6d7-4da1-b12e-91a90482065e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Volume volume-72e94714-1650-421b-a71c-b9dae6acab27 (72e94714-1650-421b-a71c-b9dae6acab27): created successfully Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9cbfa8-6448-48ed-af46-6ee5f1f6443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (a671bf74-f0cf-4ab5-8727-9779ca80a443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af01a8ca-8302-419f-9f85-4c8c9bdff7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846844481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70046a4-e88a-4439-83b2-207bc923d605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea79fe79884445ef91b7476b767ff29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:25Z,use_quota=True,user_id='3fa43d64a13b4827ad1addabee7aa9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dc64fc-7b0f-4f1f-ad1d-e789f953d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dc64fc-7b0f-4f1f-ad1d-e789f953d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8015a2d-e2da-4bf4-9d43-594b0bfaf91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:53:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aef2bbd9-bb06-40a5-93a8-a37f95601ebe tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:53:25 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 Sep 02 12:53:25 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:25 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:26 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86 Sep 02 12:53:26 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8015a2d-e2da-4bf4-9d43-594b0bfaf91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f70046a4-e88a-4439-83b2-207bc923d605', 'volume_name': 'volume-f70046a4-e88a-4439-83b2-207bc923d605', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a7319-4e70-439a-94a5-d6727b0478b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a7319-4e70-439a-94a5-d6727b0478b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16f9b18-ea39-4d6e-a80c-bb2341cc6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Volume f70046a4-e88a-4439-83b2-207bc923d605: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f70046a4-e88a-4439-83b2-207bc923d605', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Trying to clone f70046a4-e88a-4439-83b2-207bc923d605 from image 522e45ed-34d8-4082-932f-8d27db1e62a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:53:26 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd59abab-9fde-4b61-8286-0770ca218f86" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-cd59abab-9fde-4b61-8286-0770ca218f86" released by "delete_volume" :: held 0.827s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Created reservations ['e1d2464f-3055-494b-8663-1c7ceedb31b8', '5e130c27-7df8-4931-8946-827ce2852492', '903ce2c8-7f8c-4f05-bdad-590e07760fab', '431498da-b0bb-4de1-b517-f4048d6ad05f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:53:26 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Image download 20.69 MB at 20.69 MB/s Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4f5d8-48aa-46ee-916b-7c413b60fd4a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:26 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:26 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (2772a0b3-42ff-49dd-b74e-034138504e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:26 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD Sep 02 12:53:26 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b49ecd-a36a-46b6-90c1-4be80e911f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b49ecd-a36a-46b6-90c1-4be80e911f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1930704385',display_name='tempest-VolumesGetTest-Volume-1235085246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8586012-ffe4-4410-8520-40f3b7991fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:27Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990626ec-24ea-4a4a-979f-f394b2e7baae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990626ec-24ea-4a4a-979f-f394b2e7baae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb9e61a-9098-44b2-9970-e0d71b1b5afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb9e61a-9098-44b2-9970-e0d71b1b5afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8586012-ffe4-4410-8520-40f3b7991fb2', 'volume_name': 'volume-c8586012-ffe4-4410-8520-40f3b7991fb2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ba97db-158b-46b0-8768-972e37ac257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ba97db-158b-46b0-8768-972e37ac257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9682f5c2-2832-47ff-a7b4-54e6e0e847ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Volume c8586012-ffe4-4410-8520-40f3b7991fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8586012-ffe4-4410-8520-40f3b7991fb2', 'volume_size': 1} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1930704385',display_name='tempest-VolumesGetTest-Volume-1235085246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8586012-ffe4-4410-8520-40f3b7991fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93698377f05949dc937d4052455168b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:27Z,use_quota=True,user_id='f4f4e8c42cf849d2ab8e4140b95f9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Creating volume c8586012-ffe4-4410-8520-40f3b7991fb2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:26 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 1073741824 Sep 02 12:53:26 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:27 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.305s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Deleted volume successfully. Sep 02 12:53:27 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 is fetched for user 3fa43d64a13b4827ad1addabee7aa9dc. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-458e0bc3-5869-486e-92c2-c3cb68f3aa73 tempest-VolumesTestJSON-891292887 None] Lock "cinder-cd59abab-9fde-4b61-8286-0770ca218f86-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3361a12d-2408-40b9-a70f-47798dc214f1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:27 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD Sep 02 12:53:27 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:27 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 1073741824" returned: 0 in 0.540s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:27 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-14e0f3dd-06ec-401b-99af-827af6dddce7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:27 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 Sep 02 12:53:27 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "cinder-14e0f3dd-06ec-401b-99af-827af6dddce7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-quobyte-14e0f3dd-06ec-401b-99af-827af6dddce7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-14e0f3dd-06ec-401b-99af-827af6dddce7" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a0c0e3-9149-49d6-93f5-5950e14e3b04]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Flow 'volume_create_manager' (03e089a3-1be4-4778-8dea-fb83d208df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:28 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 Sep 02 12:53:28 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0e0c3-85fa-47ce-9dde-43aebec43004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846844481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70046a4-e88a-4439-83b2-207bc923d605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea79fe79884445ef91b7476b767ff29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:25Z,use_quota=True,user_id='3fa43d64a13b4827ad1addabee7aa9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Creating volume f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0e0c3-85fa-47ce-9dde-43aebec43004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-417447072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b602462e-084c-46be-912a-cf75d6e2eb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1801355c9354ca2a3ce4977269729b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:28Z,use_quota=True,user_id='b0955043bc1c461cbfe9acbc418c901b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1073741824 Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3702b58-9e83-4263-9793-c04a7e14ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3702b58-9e83-4263-9793-c04a7e14ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fc54b6-54fa-4676-b17c-a4a65664a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fc54b6-54fa-4676-b17c-a4a65664a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b602462e-084c-46be-912a-cf75d6e2eb58', 'volume_name': 'volume-b602462e-084c-46be-912a-cf75d6e2eb58', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10061a66-20c7-40aa-bf2d-ee08ea9bce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10061a66-20c7-40aa-bf2d-ee08ea9bce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dc51a7-5309-40a0-8000-2aaae133575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Volume b602462e-084c-46be-912a-cf75d6e2eb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b602462e-084c-46be-912a-cf75d6e2eb58', 'volume_size': 1} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9682f5c2-2832-47ff-a7b4-54e6e0e847ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8586012-ffe4-4410-8520-40f3b7991fb2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f51ec0-69a7-4c00-a3bf-b461d87ee10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Volume volume-c8586012-ffe4-4410-8520-40f3b7991fb2 (c8586012-ffe4-4410-8520-40f3b7991fb2): created successfully Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f51ec0-69a7-4c00-a3bf-b461d87ee10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Flow 'volume_create_manager' (2772a0b3-42ff-49dd-b74e-034138504e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-36b2a9f1-4e06-4f7a-998a-b15a6b2644b5 tempest-VolumesGetTest-654292038 None] Created volume successfully. Sep 02 12:53:28 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:28 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7 Sep 02 12:53:28 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1073741824" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:28 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-14e0f3dd-06ec-401b-99af-827af6dddce7" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-14e0f3dd-06ec-401b-99af-827af6dddce7" released by "delete_volume" :: held 0.783s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:28 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 Sep 02 12:53:28 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Created reservations ['a92f3bf5-4ab9-44e2-9c06-2783cb499930', '27f5415d-2972-4704-8376-ee8d8425be44', '4f039f8b-3a06-49db-aab6-5abe24c36c39', '4b2cd0f2-b3f2-4025-a69b-271384bfbe4b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:28 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:28 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-417447072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b602462e-084c-46be-912a-cf75d6e2eb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1801355c9354ca2a3ce4977269729b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:28Z,use_quota=True,user_id='b0955043bc1c461cbfe9acbc418c901b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Creating volume b602462e-084c-46be-912a-cf75d6e2eb58 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-f19a6158-8adf-4a3c-9b15-0f072abd2051-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:28 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 1073741824 Sep 02 12:53:28 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "cinder-f19a6158-8adf-4a3c-9b15-0f072abd2051-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:28 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Attempting download of 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume f70046a4-e88a-4439-83b2-207bc923d605. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Acquiring lock "cinder-quobyte-f19a6158-8adf-4a3c-9b15-0f072abd2051" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:29 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-f19a6158-8adf-4a3c-9b15-0f072abd2051" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cc70ec-e11e-42f1-a2ff-59ac511479b6]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Deleted volume successfully. Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948254c-97fd-41af-a29c-9d6570adc73d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-c8586012-ffe4-4410-8520-40f3b7991fb2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16919dfa-ec63-41ef-9ee9-cdb7f5e611fe tempest-VolumesTestJSON-891292887 None] Lock "cinder-14e0f3dd-06ec-401b-99af-827af6dddce7-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "cinder-c8586012-ffe4-4410-8520-40f3b7991fb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-c8586012-ffe4-4410-8520-40f3b7991fb2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-c8586012-ffe4-4410-8520-40f3b7991fb2" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:29 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t Sep 02 12:53:29 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1161d50-04f0-4aac-9c08-fc447bcf8a77]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 Sep 02 12:53:29 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 Sep 02 12:53:29 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t" returned: 0 in 0.415s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 1073741824" returned: 0 in 0.622s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 Sep 02 12:53:29 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t Sep 02 12:53:29 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051 Sep 02 12:53:29 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2 Sep 02 12:53:29 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:29 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dc51a7-5309-40a0-8000-2aaae133575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b602462e-084c-46be-912a-cf75d6e2eb58', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d616cad0-9bb1-4add-a19c-0f1424e76fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Volume volume-b602462e-084c-46be-912a-cf75d6e2eb58 (b602462e-084c-46be-912a-cf75d6e2eb58): created successfully Sep 02 12:53:29 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d616cad0-9bb1-4add-a19c-0f1424e76fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:29 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Flow 'volume_create_manager' (03e089a3-1be4-4778-8dea-fb83d208df50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t" returned: 1 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_y6d6ux9t' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f19a6158-8adf-4a3c-9b15-0f072abd2051" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2088db5f-0544-4498-8ca4-0f009de5a659]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6869c92e-2b18-419c-8ebf-b123a82710fc tempest-VolumesTransfersTest-1463676946 None] Created volume successfully. Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "cinder-quobyte-f19a6158-8adf-4a3c-9b15-0f072abd2051" released by "delete_volume" :: held 0.875s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:29 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c8586012-ffe4-4410-8520-40f3b7991fb2" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Created reservations ['0e6aaf10-29e0-4044-b9e4-ada320539b01', 'fa7fde77-1790-4ad3-9ae9-817121766c0f', '6dad1fe5-2b42-45ba-acfe-35a0273c9b5e', 'a2dd73e8-e6d9-41f9-94e6-96fc69389e7a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-c8586012-ffe4-4410-8520-40f3b7991fb2" released by "delete_volume" :: held 0.786s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:30 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD Sep 02 12:53:30 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Created reservations ['e7ef1003-fa1e-4a2e-be04-9d43f4d49369', '31b51dd2-2b0c-49c3-a090-07b162b1631e', 'a3e7463f-adae-4aff-bfe3-990009edcbd9', 'a5a3dac6-95b4-41e8-bf1f-435ab2e988af'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:30 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:30 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:30 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:30 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:30 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] 522e45ed-34d8-4082-932f-8d27db1e62a2 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-72e94714-1650-421b-a71c-b9dae6acab27-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:30 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:30 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 Sep 02 12:53:30 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.338s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "cinder-72e94714-1650-421b-a71c-b9dae6acab27-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Deleted volume successfully. Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ee6caf-51ec-426e-9d48-51d43dacfbaf tempest-VolumesTestJSON-891292887 None] Lock "cinder-f19a6158-8adf-4a3c-9b15-0f072abd2051-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Acquiring lock "cinder-quobyte-72e94714-1650-421b-a71c-b9dae6acab27" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-72e94714-1650-421b-a71c-b9dae6acab27" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa54877-e20a-4565-802b-88b6263b2837]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:30 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:53:30 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 Sep 02 12:53:30 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22be8e1d-21b9-4512-9326-c76efa251e54 tempest-VolumesGetTest-654292038 None] Lock "cinder-c8586012-ffe4-4410-8520-40f3b7991fb2-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-11dfaa3f-422c-4bd5-b960-3ee00a431042 tempest-VolumesTransfersTest-453216187 None] Transfer volume completed successfully. Sep 02 12:53:31 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:31 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27 Sep 02 12:53:31 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:31 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72e94714-1650-421b-a71c-b9dae6acab27" returned: 0 in 0.317s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "cinder-quobyte-72e94714-1650-421b-a71c-b9dae6acab27" released by "delete_volume" :: held 0.832s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Acquiring lock "cinder-b602462e-084c-46be-912a-cf75d6e2eb58-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "cinder-b602462e-084c-46be-912a-cf75d6e2eb58-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Created reservations ['4fcb9a3b-0942-4b8d-9f85-714d4a7b08f0', '90d5d43f-1162-4830-9493-bd9892e6de3e', 'b120bffe-77d1-4ca0-94ee-07beb4efaf20', '725830a0-99ac-4b70-9684-74700fb44c1f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Acquiring lock "cinder-quobyte-b602462e-084c-46be-912a-cf75d6e2eb58" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "cinder-quobyte-b602462e-084c-46be-912a-cf75d6e2eb58" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[13529efd-35e3-40e7-b014-b3e25a9885a5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:31 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:31 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:31 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 Sep 02 12:53:31 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:31 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Deleted volume successfully. Sep 02 12:53:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-889a184e-eb36-42c1-9a0c-a8f84b2f3aad tempest-VolumesGetTest-654292038 None] Lock "cinder-72e94714-1650-421b-a71c-b9dae6acab27-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:32 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:32 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58 Sep 02 12:53:32 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:32 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b602462e-084c-46be-912a-cf75d6e2eb58" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "cinder-quobyte-b602462e-084c-46be-912a-cf75d6e2eb58" released by "delete_volume" :: held 0.850s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Created reservations ['f1bfec32-0413-49c0-a8a7-79a12f2da9e3', '29784c0b-b0ad-4924-b861-127cd44c7bcf', 'a98f2db8-24a0-4c99-995c-f4b3dc18368a', 'd5d9de73-78dd-4db8-9e0b-f7405a1c6f39'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:32 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:32 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:32 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605" returned: 0 in 2.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_b9k97xqbdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:53:32 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Converted 112.00 MB image at 48.59 MB/s Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:32 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1G Sep 02 12:53:32 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:32 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Deleted volume successfully. Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d9f84a7-df89-4283-94e1-d632aaae4a5a tempest-VolumesTransfersTest-826780586 None] Lock "cinder-b602462e-084c-46be-912a-cf75d6e2eb58-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:33 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 1G" returned: 0 in 0.438s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Downloaded image 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume f70046a4-e88a-4439-83b2-207bc923d605 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 for user 3fa43d64a13b4827ad1addabee7aa9dc is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Marking volume f70046a4-e88a-4439-83b2-207bc923d605 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Copying metadata from image 522e45ed-34d8-4082-932f-8d27db1e62a2 to f70046a4-e88a-4439-83b2-207bc923d605. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Creating volume glance metadata for volume f70046a4-e88a-4439-83b2-207bc923d605 backed by image 522e45ed-34d8-4082-932f-8d27db1e62a2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16f9b18-ea39-4d6e-a80c-bb2341cc6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70046a4-e88a-4439-83b2-207bc923d605', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ffd87-464a-4c31-8043-c30cfd851348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Volume volume-f70046a4-e88a-4439-83b2-207bc923d605 (f70046a4-e88a-4439-83b2-207bc923d605): created successfully Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ffd87-464a-4c31-8043-c30cfd851348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Flow 'volume_create_manager' (d6f9b0c7-75c0-44a3-9e90-44b9cbdd341d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a85e8ad1-d1f2-4ea6-be62-c71c68e8e3df tempest-VolumesExtendTest-906194488 None] Created volume successfully. Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Flow 'volume_create_manager' (71e8b662-3ddd-40f2-a820-d096d79fc692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a65b11-86ec-4516-a9db-0e82bee5639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a65b11-86ec-4516-a9db-0e82bee5639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1320164715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f98232-3059-446c-b016-11feb6431e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1801355c9354ca2a3ce4977269729b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:33Z,use_quota=True,user_id='b0955043bc1c461cbfe9acbc418c901b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45c81c8-9349-431f-b283-5f0c1b6d3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45c81c8-9349-431f-b283-5f0c1b6d3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2cab90-22ed-4e5b-9184-90f49fcefacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2cab90-22ed-4e5b-9184-90f49fcefacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f98232-3059-446c-b016-11feb6431e79', 'volume_name': 'volume-73f98232-3059-446c-b016-11feb6431e79', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202eff13-1307-4d6b-b0cc-f2bd9f505f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202eff13-1307-4d6b-b0cc-f2bd9f505f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e673b3f-fd1c-41cb-979f-3943303935b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Volume 73f98232-3059-446c-b016-11feb6431e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f98232-3059-446c-b016-11feb6431e79', 'volume_size': 1} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1320164715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f98232-3059-446c-b016-11feb6431e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1801355c9354ca2a3ce4977269729b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:33Z,use_quota=True,user_id='b0955043bc1c461cbfe9acbc418c901b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Creating volume 73f98232-3059-446c-b016-11feb6431e79 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:33 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 1073741824 Sep 02 12:53:33 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:34 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 1073741824" returned: 0 in 0.511s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:34 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 Sep 02 12:53:34 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:34 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79" returned: 0 in 0.339s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.206s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e673b3f-fd1c-41cb-979f-3943303935b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f98232-3059-446c-b016-11feb6431e79', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a689ca17-c485-4993-af7d-560c18143920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6efdf-2ef7-4ab7-a748-253cda004842]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Volume volume-73f98232-3059-446c-b016-11feb6431e79 (73f98232-3059-446c-b016-11feb6431e79): created successfully Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a689ca17-c485-4993-af7d-560c18143920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Flow 'volume_create_manager' (71e8b662-3ddd-40f2-a820-d096d79fc692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a94caa34-55e4-41cf-92c9-cfe1d7cede83 tempest-VolumesTransfersTest-1463676946 None] Created volume successfully. Sep 02 12:53:34 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 Sep 02 12:53:34 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:34 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 2G" returned: 0 in 0.110s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.561s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-dd6476f7-571d-426f-9fc8-d7b5c1b68eec tempest-VolumesExtendTest-906194488 None] Extend volume completed successfully. Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-f70046a4-e88a-4439-83b2-207bc923d605-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "cinder-f70046a4-e88a-4439-83b2-207bc923d605-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-quobyte-f70046a4-e88a-4439-83b2-207bc923d605" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-f70046a4-e88a-4439-83b2-207bc923d605" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd53240-999e-4c2a-89db-04d0b5a8e629]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:35 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 Sep 02 12:53:35 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Acquiring lock "cinder-73f98232-3059-446c-b016-11feb6431e79-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "cinder-73f98232-3059-446c-b016-11feb6431e79-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Acquiring lock "cinder-quobyte-73f98232-3059-446c-b016-11feb6431e79" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "cinder-quobyte-73f98232-3059-446c-b016-11feb6431e79" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20b891d-ebeb-4f59-8f5a-33d36952fad8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:36 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 Sep 02 12:53:36 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:36 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605" returned: 0 in 0.579s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:36 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605 Sep 02 12:53:36 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:36 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:36 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79 Sep 02 12:53:36 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:36 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f70046a4-e88a-4439-83b2-207bc923d605" returned: 0 in 0.317s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-f70046a4-e88a-4439-83b2-207bc923d605" released by "delete_volume" :: held 0.967s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Created reservations ['97654df8-327e-4116-8afb-03c5512c1b2c', '441e1d84-896e-4b10-9f06-a6bcff95b1b7', '95b4faf1-21f3-4054-b15a-f43341ba990a', '4508de86-9a6f-4148-9f33-69d4deb27b55'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:36 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:36 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:36 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73f98232-3059-446c-b016-11feb6431e79" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "cinder-quobyte-73f98232-3059-446c-b016-11feb6431e79" released by "delete_volume" :: held 0.836s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Created reservations ['7f5d142d-b009-4aca-9a2a-572d65630a98', 'a521b4e4-3e1c-4896-b999-14fbec602eef', '1cf60265-a422-4e59-ae7c-eb4dd01f560e', '3b2734cb-1cb0-424b-9279-3eb68dbefe57'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:37 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:37 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:37 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.519s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Deleted volume successfully. Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:37 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:37 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f01b5487-f921-4f23-8d93-23783fccf4c6 tempest-VolumesExtendTest-906194488 None] Lock "cinder-f70046a4-e88a-4439-83b2-207bc923d605-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:37 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Deleted volume successfully. Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98f6d82a-82df-48d7-a754-941753748808 tempest-VolumesTransfersTest-826780586 None] Lock "cinder-73f98232-3059-446c-b016-11feb6431e79-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Flow 'volume_create_manager' (9eba27db-cd8c-4606-9d55-2bd1b334ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d492ef58-34de-474c-b16a-d031486b8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:37 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d492ef58-34de-474c-b16a-d031486b8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1753722391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9a203e-b3f5-4c19-a034-cc11608a5de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea79fe79884445ef91b7476b767ff29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:38Z,use_quota=True,user_id='3fa43d64a13b4827ad1addabee7aa9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f045f319-1fde-4117-85a2-db03f5d9ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f045f319-1fde-4117-85a2-db03f5d9ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f24f02-c079-4e16-9372-4ef0c36c2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f24f02-c079-4e16-9372-4ef0c36c2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9a203e-b3f5-4c19-a034-cc11608a5de8', 'volume_name': 'volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a6f41-e39a-49e9-b3ea-b11f79536952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a6f41-e39a-49e9-b3ea-b11f79536952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c8e447-8862-43e2-833d-26f5ccbc4ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Volume ce9a203e-b3f5-4c19-a034-cc11608a5de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8', 'volume_size': 1} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1753722391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9a203e-b3f5-4c19-a034-cc11608a5de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea79fe79884445ef91b7476b767ff29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:38Z,use_quota=True,user_id='3fa43d64a13b4827ad1addabee7aa9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Creating volume ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:53:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:53:37 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 1073741824 Sep 02 12:53:37 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:38 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 1073741824" returned: 0 in 0.596s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:38 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:38 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:38 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c8e447-8862-43e2-833d-26f5ccbc4ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b6b0a-12ad-4a49-8a30-acdd78ca0601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Volume volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 (ce9a203e-b3f5-4c19-a034-cc11608a5de8): created successfully Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b6b0a-12ad-4a49-8a30-acdd78ca0601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Flow 'volume_create_manager' (9eba27db-cd8c-4606-9d55-2bd1b334ac97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-09ff58de-0b05-45f0-a1f5-3cfc148836ec tempest-VolumesExtendTest-906194488 None] Created volume successfully. Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Creating offline snapshot 97873b48-d805-4266-bb19-8138daa688b7 of volume ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdffa4d8-e0a3-4b53-8ccc-30c585ac0044]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:40 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:40 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:40 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.568s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:40 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 1G Sep 02 12:53:40 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:41 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 1G" returned: 0 in 0.594s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:41 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 Sep 02 12:53:41 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Flow 'volume_create_manager' (6a4885aa-6934-402e-a9bc-43e5f080b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36232187-9c3b-45f6-9eed-c81b567589b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36232187-9c3b-45f6-9eed-c81b567589b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff05c38-31e6-4562-b4c0-c7153b4d7661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce114c231a9947769db836c0259b0148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:42Z,use_quota=True,user_id='e04e9b8c10d24249b17908c57de57da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2ea5ad7-a955-4c77-ab7a-eae161f058de),volume_type_id=f2ea5ad7-a955-4c77-ab7a-eae161f058de)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf157e7-ed4c-4232-954f-9e9c022c4c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf157e7-ed4c-4232-954f-9e9c022c4c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff171351-5c57-4469-9182-57506dadc067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:53:41 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:41 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 is being set with open permissions: ugo+rw Sep 02 12:53:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:41 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 Sep 02 12:53:41 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:42 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:42 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info Sep 02 12:53:42 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:42 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info is being set with open permissions: ugo+rw Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:42 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info Sep 02 12:53:42 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff171351-5c57-4469-9182-57506dadc067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ff05c38-31e6-4562-b4c0-c7153b4d7661', 'volume_name': 'volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661', 'volume_size': 1, 'image_id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '210e241a3995871a31620c4bce5d8ce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce114c231a9947769db836c0259b0148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bfa59cdd453f16fb19309ac6989787f66a09423a30b3ca5033aec4dba5d26b344f663099d75f435b833bd2b3f0f9d9f2746265a47e5331674c0ac502d298a34', 'id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'created_at': datetime.datetime(2026, 9, 2, 10, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 53, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a87612-a410-4d0a-9691-be593a971be4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a119671-dde2-42ad-9f64-5d5cf3132fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a119671-dde2-42ad-9f64-5d5cf3132fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bc70b8-8d45-4fd6-b2c3-7173dc509828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661', 'volume_size': 1, 'image_id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '210e241a3995871a31620c4bce5d8ce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce114c231a9947769db836c0259b0148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bfa59cdd453f16fb19309ac6989787f66a09423a30b3ca5033aec4dba5d26b344f663099d75f435b833bd2b3f0f9d9f2746265a47e5331674c0ac502d298a34', 'id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'created_at': datetime.datetime(2026, 9, 2, 10, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 53, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a87612-a410-4d0a-9691-be593a971be4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Trying to clone 5ff05c38-31e6-4562-b4c0-c7153b4d7661 from image b5a87612-a410-4d0a-9691-be593a971be4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:53:42 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Image download 0.00 MB at 0.00 MB/s Sep 02 12:53:42 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.info" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b428b68a-ac1a-453c-82df-a936fdbb32c1]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-53138d20-0b97-49ae-bdaa-675f23ec4e15 tempest-VolumesExtendTest-906194488 None] Create snapshot completed successfully Sep 02 12:53:43 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:43 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:43 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:43 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:43 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bd555-a73e-486d-b264-a6ba03f3f634]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7194e9a7-28ba-41ef-818f-abfbe9c1bda5 tempest-GroupsTest-22283910 None] Group tempest-Group1-1970575606: creating Sep 02 12:53:43 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:43 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7194e9a7-28ba-41ef-818f-abfbe9c1bda5 tempest-GroupsTest-22283910 None] Group tempest-Group1-1970575606: created successfully Sep 02 12:53:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7194e9a7-28ba-41ef-818f-abfbe9c1bda5 tempest-GroupsTest-22283910 None] Create group completed successfully. Sep 02 12:53:43 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Temporary image b5a87612-a410-4d0a-9691-be593a971be4 is fetched for user e04e9b8c10d24249b17908c57de57da5. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc397140-faa7-489e-99a0-0cbbe243a52d]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:43 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:43 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:43 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 2G" returned: 0 in 0.146s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.665s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:44 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6a547d3a-a9ba-4e62-975b-6bf1c2898772 tempest-VolumesExtendTest-906194488 None] Extend volume completed successfully. Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:44 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:44 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:44 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff05c38-31e6-4562-b4c0-c7153b4d7661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce114c231a9947769db836c0259b0148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:42Z,use_quota=True,user_id='e04e9b8c10d24249b17908c57de57da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2ea5ad7-a955-4c77-ab7a-eae161f058de),volume_type_id=f2ea5ad7-a955-4c77-ab7a-eae161f058de)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Creating volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:44 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1073741824 Sep 02 12:53:44 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-97873b48-d805-4266-bb19-8138daa688b7-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-97873b48-d805-4266-bb19-8138daa688b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-quobyte-97873b48-d805-4266-bb19-8138daa688b7" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-97873b48-d805-4266-bb19-8138daa688b7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Deleting offline snapshot 97873b48-d805-4266-bb19-8138daa688b7 of volume ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] snapshot_file for this snap is: volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb519332-370e-44ba-8115-e690c0b3f0f7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b977555-3902-4cec-a7b9-c915ff3392f0 tempest-GroupsTest-22283910 None] Group tempest-Group2-2023643981: creating Sep 02 12:53:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b977555-3902-4cec-a7b9-c915ff3392f0 tempest-GroupsTest-22283910 None] Group tempest-Group2-2023643981: created successfully Sep 02 12:53:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b977555-3902-4cec-a7b9-c915ff3392f0 tempest-GroupsTest-22283910 None] Create group completed successfully. Sep 02 12:53:45 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 Sep 02 12:53:45 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:45 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1073741824" returned: 0 in 0.659s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:45 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 Sep 02 12:53:45 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:45 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1aa62-3a3c-41c4-8d68-d70c0ec0409b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:45 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Attempting download of b5a87612-a410-4d0a-9691-be593a971be4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}])) to volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:53:45 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:45 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ba511-7b8b-45b2-97f0-dcd9a1e2769c]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:45 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w Sep 02 12:53:45 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:46 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:46 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 Sep 02 12:53:46 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:46 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:46 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w Sep 02 12:53:46 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:46 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:46 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w" returned: 1 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a87612-a410-4d0a-9691-be593a971be4_qj3_j23w' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b2237-9646-4006-b9af-5692d61fc4ed]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:46 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7 Sep 02 12:53:46 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:46 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:46 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:46 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8.97873b48-d805-4266-bb19-8138daa688b7" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:DELETE=20,cinder:SELECT=184,cinder:UPDATE=228,cinder:INSERT=75 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-97873b48-d805-4266-bb19-8138daa688b7" released by "_delete_snapshot" :: held 2.002s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (b11686d3-14ef-4ebb-b701-8d1c66e7ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d5caa-875c-4429-84e2-3c59e52cb74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" released by "delete_snapshot" :: held 2.084s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d5caa-875c-4429-84e2-3c59e52cb74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1157858809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7d00f9-79c7-4b62-82d7-ac0c7c5e5d1c,host='devstack@QuobyteHD#QuobyteHD',id=702b38e1-2e54-43b2-8813-29965a679665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:47Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50984990-c41e-4e6a-af6a-68f2c9bf6bbd),volume_type_id=50984990-c41e-4e6a-af6a-68f2c9bf6bbd)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d34dd7b-2505-4c9e-9bb3-2fa1f426e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d34dd7b-2505-4c9e-9bb3-2fa1f426e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cab3a6-8b5c-471a-b666-c26b5a2402e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cab3a6-8b5c-471a-b666-c26b5a2402e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702b38e1-2e54-43b2-8813-29965a679665', 'volume_name': 'volume-702b38e1-2e54-43b2-8813-29965a679665', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249aee9-2ead-49f2-bdda-ad63c7076649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249aee9-2ead-49f2-bdda-ad63c7076649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66b8bb-6c09-438d-af7c-22bcf5fa40a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Volume 702b38e1-2e54-43b2-8813-29965a679665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702b38e1-2e54-43b2-8813-29965a679665', 'volume_size': 1} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:47 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f7d00f9-79c7-4b62-82d7-ac0c7c5e5d1c,created_at=2026-09-02T10:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1157858809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7d00f9-79c7-4b62-82d7-ac0c7c5e5d1c,host='devstack@QuobyteHD#QuobyteHD',id=702b38e1-2e54-43b2-8813-29965a679665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:47Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50984990-c41e-4e6a-af6a-68f2c9bf6bbd),volume_type_id=50984990-c41e-4e6a-af6a-68f2c9bf6bbd)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Creating volume 702b38e1-2e54-43b2-8813-29965a679665 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:47 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 1073741824 Sep 02 12:53:47 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Created reservations ['fd053c2b-79fd-412c-a04c-c61bb247de37', '0fda9bbf-e942-4292-9963-44a5d13c099f', '7eef9261-be17-407b-b876-f163eb0d96c9', '7ec7babe-5002-4969-8f97-a73fcd7ca559'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:47 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD Sep 02 12:53:47 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Delete snapshot completed successfully. Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b2c096-fe55-439b-bd05-41d75703a78a tempest-VolumesExtendTest-906194488 None] Lock "cinder-97873b48-d805-4266-bb19-8138daa688b7-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:47 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] b5a87612-a410-4d0a-9691-be593a971be4 was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:47 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 Sep 02 12:53:47 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:47 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 1073741824" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:47 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 Sep 02 12:53:47 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:47 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b66b8bb-6c09-438d-af7c-22bcf5fa40a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702b38e1-2e54-43b2-8813-29965a679665', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cde149f-4b57-48f4-a03e-031275c2ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Volume volume-702b38e1-2e54-43b2-8813-29965a679665 (702b38e1-2e54-43b2-8813-29965a679665): created successfully Sep 02 12:53:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cde149f-4b57-48f4-a03e-031275c2ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (b11686d3-14ef-4ebb-b701-8d1c66e7ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9288425b-887d-4c00-b55e-0ceb320bdfb1 tempest-GroupsTest-22283910 None] Created volume successfully. Sep 02 12:53:48 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661" returned: 0 in 0.505s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5a87612-a410-4d0a-9691-be593a971be4_rkapu8r1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:53:48 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:48 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1G Sep 02 12:53:48 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-ce9a203e-b3f5-4c19-a034-cc11608a5de8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "cinder-ce9a203e-b3f5-4c19-a034-cc11608a5de8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Acquiring lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[085fad64-8667-41e7-a090-22cf44a851ec]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:48 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:48 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:48 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 1G" returned: 0 in 0.562s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Downloaded image b5a87612-a410-4d0a-9691-be593a971be4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}])) to volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Temporary image b5a87612-a410-4d0a-9691-be593a971be4 for user e04e9b8c10d24249b17908c57de57da5 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Marking volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Copying metadata from image b5a87612-a410-4d0a-9691-be593a971be4 to 5ff05c38-31e6-4562-b4c0-c7153b4d7661. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Creating volume glance metadata for volume 5ff05c38-31e6-4562-b4c0-c7153b4d7661 backed by image b5a87612-a410-4d0a-9691-be593a971be4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '210e241a3995871a31620c4bce5d8ce5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bc70b8-8d45-4fd6-b2c3-7173dc509828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661', 'volume_size': 1, 'image_id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a87612-a410-4d0a-9691-be593a971be4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '210e241a3995871a31620c4bce5d8ce5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce114c231a9947769db836c0259b0148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bfa59cdd453f16fb19309ac6989787f66a09423a30b3ca5033aec4dba5d26b344f663099d75f435b833bd2b3f0f9d9f2746265a47e5331674c0ac502d298a34', 'id': 'b5a87612-a410-4d0a-9691-be593a971be4', 'created_at': datetime.datetime(2026, 9, 2, 10, 53, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 53, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a87612-a410-4d0a-9691-be593a971be4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c33c04d-b518-4e65-91de-16ee36467853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Volume volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 (5ff05c38-31e6-4562-b4c0-c7153b4d7661): created successfully Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c33c04d-b518-4e65-91de-16ee36467853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Flow 'volume_create_manager' (6a4885aa-6934-402e-a9bc-43e5f080b30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-671987bd-a808-4c82-9e74-c28d6138b39f tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Created volume successfully. Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Acquiring lock "cinder-quobyte-702b38e1-2e54-43b2-8813-29965a679665" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-702b38e1-2e54-43b2-8813-29965a679665" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1803932b-58ad-4b2c-8d9e-7f32344ed8d7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:49 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:49 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8 Sep 02 12:53:49 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:49 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 Sep 02 12:53:49 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:49 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ce9a203e-b3f5-4c19-a034-cc11608a5de8" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "cinder-quobyte-ce9a203e-b3f5-4c19-a034-cc11608a5de8" released by "delete_volume" :: held 0.907s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:49 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665" returned: 0 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Created reservations ['a06451d3-ad74-4706-8614-1e8137bf7250', 'c61fe17e-6fb5-4fda-85f8-1de531927ce1', 'd99a3cf1-0691-4072-99a3-a9f4da5d7a81', '8bcebfc5-13ab-4781-b636-136d4212cee9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:49 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665 Sep 02 12:53:49 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Acquiring lock "cinder-5ff05c38-31e6-4562-b4c0-c7153b4d7661-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "cinder-5ff05c38-31e6-4562-b4c0-c7153b4d7661-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Acquiring lock "cinder-quobyte-5ff05c38-31e6-4562-b4c0-c7153b4d7661" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "cinder-quobyte-5ff05c38-31e6-4562-b4c0-c7153b4d7661" acquired by "delete_volume" :: waited 0.064s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:53:49 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:49 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[737249e4-8285-4715-897d-364fe93b0ce4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:49 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-702b38e1-2e54-43b2-8813-29965a679665" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-702b38e1-2e54-43b2-8813-29965a679665" released by "delete_volume" :: held 0.798s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:49 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 Sep 02 12:53:49 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Created reservations ['73ec7ad9-c9ff-441c-981c-7302b9fe02ca'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:50 devstack cinder-volume[87092]: WARNING cinder.quota [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1614809072 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1614809072, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:53:50 devstack cinder-volume[87092]: WARNING cinder.quota [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1614809072 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1614809072, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:53:50 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.487s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Deleted volume successfully. Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Created reservations ['f2358207-008c-452b-b436-daf47e165456', '98b7b415-a5e6-49fb-ab66-b49a61a99f63', '55683a71-69e4-4098-ab45-49521f434efd', '15e38b02-a0d6-499c-bcab-822cb9ee9417'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b77b8673-47c9-4aee-97e6-d19df0e43664 tempest-VolumesExtendTest-906194488 None] Lock "cinder-ce9a203e-b3f5-4c19-a034-cc11608a5de8-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:50 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661" returned: 0 in 0.717s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:50 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:50 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:50 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661 Sep 02 12:53:50 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:50 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ff05c38-31e6-4562-b4c0-c7153b4d7661" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "cinder-quobyte-5ff05c38-31e6-4562-b4c0-c7153b4d7661" released by "delete_volume" :: held 1.106s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:50 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2b74b3d0-8355-4a43-aea1-1e9346a4a4b8 tempest-GroupsTest-22283910 None] Delete group completed successfully. Sep 02 12:53:50 devstack cinder-volume[87092]: WARNING cinder.quota [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:53:50 devstack cinder-volume[87092]: WARNING cinder.quota [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Created reservations ['43ae8744-a1d8-429c-a97d-2548ec262ebe', 'f4b53431-1678-4694-8ba6-152c7ea198fd', 'cd65c00e-168f-4b62-a0d8-914991fca65e', '62b3eb1b-3418-4f70-8b37-a86bcd26b24c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:50 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:50 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:51 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Deleted volume successfully. Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-44e93834-10f9-4bd0-96d5-d7fe300d948d tempest-VolumeAndVolumeTypeFromImageTest-1381223591 None] Lock "cinder-5ff05c38-31e6-4562-b4c0-c7153b4d7661-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Created reservations ['d6ffc9e4-63fd-4183-883f-da57a8cfc34a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:51 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:53:51 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:52 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:53:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1c1166b9-9bc2-4bcf-a2a4-0f9286c5fad4 tempest-GroupsTest-22283910 None] Delete group completed successfully. Sep 02 12:53:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1895b8b2-b0f8-4e93-be63-8a5244be1801 tempest-GroupsTest-22283910 None] Group tempest-GroupsTest-Group-1741276619: creating Sep 02 12:53:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1895b8b2-b0f8-4e93-be63-8a5244be1801 tempest-GroupsTest-22283910 None] Group tempest-GroupsTest-Group-1741276619: created successfully Sep 02 12:53:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1895b8b2-b0f8-4e93-be63-8a5244be1801 tempest-GroupsTest-22283910 None] Create group completed successfully. Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (cd268627-154b-4187-b309-5698ffe9dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894302d4-9423-4271-97b8-402ea85eb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894302d4-9423-4271-97b8-402ea85eb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203349014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,host='devstack@QuobyteHD#QuobyteHD',id=7697a141-8789-4a0f-b732-f93ba1c6ea28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:55Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513161af-f687-453a-9f74-35d939a40518),volume_type_id=513161af-f687-453a-9f74-35d939a40518)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e22c2f-1e10-4589-bfb4-c64ff602db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e22c2f-1e10-4589-bfb4-c64ff602db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18beb67b-1762-41eb-ae94-49d39622bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18beb67b-1762-41eb-ae94-49d39622bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7697a141-8789-4a0f-b732-f93ba1c6ea28', 'volume_name': 'volume-7697a141-8789-4a0f-b732-f93ba1c6ea28', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ca093-7350-4f70-8051-86b533132dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ca093-7350-4f70-8051-86b533132dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919f185-2419-418f-8922-529902b90982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Volume 7697a141-8789-4a0f-b732-f93ba1c6ea28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7697a141-8789-4a0f-b732-f93ba1c6ea28', 'volume_size': 1} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,created_at=2026-09-02T10:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203349014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,host='devstack@QuobyteHD#QuobyteHD',id=7697a141-8789-4a0f-b732-f93ba1c6ea28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:55Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513161af-f687-453a-9f74-35d939a40518),volume_type_id=513161af-f687-453a-9f74-35d939a40518)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Creating volume 7697a141-8789-4a0f-b732-f93ba1c6ea28 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:55 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:55 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 1073741824 Sep 02 12:53:55 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:56 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 1073741824" returned: 0 in 0.619s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:56 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 Sep 02 12:53:56 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:56 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919f185-2419-418f-8922-529902b90982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7697a141-8789-4a0f-b732-f93ba1c6ea28', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23eab7df-1417-4dc1-adf5-b5400dcd8552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Volume volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 (7697a141-8789-4a0f-b732-f93ba1c6ea28): created successfully Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23eab7df-1417-4dc1-adf5-b5400dcd8552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (cd268627-154b-4187-b309-5698ffe9dc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Flow 'volume_create_manager' (5214ce13-4a41-4d7a-8cb7-8b4a4684167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f02fea0-9567-43da-bec4-257dbf09b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-90ad55ff-3a41-4b2e-8d27-968f279141ec tempest-GroupsTest-22283910 None] Created volume successfully. Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f02fea0-9567-43da-bec4-257dbf09b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85014550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0773ea04-9ca0-4e2c-a4cb-157b53d78640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1813a4abc049569911340cdf6b5662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:57Z,use_quota=True,user_id='b513d8195679427a8fb58862248cf0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd265318-95af-4218-810f-367d9436081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd265318-95af-4218-810f-367d9436081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad39fc5-b406-4af3-9bcf-ca15e1b20af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad39fc5-b406-4af3-9bcf-ca15e1b20af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0773ea04-9ca0-4e2c-a4cb-157b53d78640', 'volume_name': 'volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff68edbf-5403-424b-8237-3a083a2421e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff68edbf-5403-424b-8237-3a083a2421e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80df194-11c1-42c7-b1fa-c6a766d118ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640', 'volume_size': 1} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85014550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0773ea04-9ca0-4e2c-a4cb-157b53d78640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1813a4abc049569911340cdf6b5662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:57Z,use_quota=True,user_id='b513d8195679427a8fb58862248cf0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Creating volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:56 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 1073741824 Sep 02 12:53:56 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:57 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 1073741824" returned: 0 in 0.520s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:57 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:53:57 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:57 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80df194-11c1-42c7-b1fa-c6a766d118ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cd440-58a3-4a93-84c9-21bd0927d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Volume volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 (0773ea04-9ca0-4e2c-a4cb-157b53d78640): created successfully Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cd440-58a3-4a93-84c9-21bd0927d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Flow 'volume_create_manager' (5214ce13-4a41-4d7a-8cb7-8b4a4684167b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f8d6bf41-7748-4047-a34b-2d12792a3570 tempest-VolumesActionsTest-2003327171 None] Created volume successfully. Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (1596e3fb-660a-48a2-a3e5-e8c6ff993535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93532fde-fa0b-4274-8d5d-35d66bc2a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93532fde-fa0b-4274-8d5d-35d66bc2a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392992354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,host='devstack@QuobyteHD#QuobyteHD',id=d4f01014-e9e8-4fb7-9012-f68d6e0a7b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:59Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513161af-f687-453a-9f74-35d939a40518),volume_type_id=513161af-f687-453a-9f74-35d939a40518)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f81cff-92a5-4d93-8f3a-92b66534d021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f81cff-92a5-4d93-8f3a-92b66534d021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82beb65-dd8f-4717-a4bb-33df4f36b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82beb65-dd8f-4717-a4bb-33df4f36b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f01014-e9e8-4fb7-9012-f68d6e0a7b37', 'volume_name': 'volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8874e88d-b7f0-4f23-9950-cb2e381b9c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8874e88d-b7f0-4f23-9950-cb2e381b9c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c556a17-4618-48ac-a09f-eef4c50219c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Volume d4f01014-e9e8-4fb7-9012-f68d6e0a7b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37', 'volume_size': 1} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,created_at=2026-09-02T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392992354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3783fafd-8701-43cc-b76d-546e9b9c1a5c,host='devstack@QuobyteHD#QuobyteHD',id=d4f01014-e9e8-4fb7-9012-f68d6e0a7b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08efdb322b84adfae154096abe90825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:59Z,use_quota=True,user_id='c663c52e778c4e3f813af1b0c3809399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513161af-f687-453a-9f74-35d939a40518),volume_type_id=513161af-f687-453a-9f74-35d939a40518)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Creating volume d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:53:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:53:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:58 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 1073741824 Sep 02 12:53:58 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (0cbb36e8-2625-4d47-a461-c06ced237a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48570c40-740c-4aff-a204-ae6fe7b48d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:59 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 1073741824" returned: 0 in 0.669s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48570c40-740c-4aff-a204-ae6fe7b48d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-116257084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3083ac50-f1ad-4545-af12-2d6112583945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:59Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154abae5-504e-4f64-bf96-a439474c7b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154abae5-504e-4f64-bf96-a439474c7b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c707def-21ab-4d0b-a78c-ada07521a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c707def-21ab-4d0b-a78c-ada07521a751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3083ac50-f1ad-4545-af12-2d6112583945', 'volume_name': 'volume-3083ac50-f1ad-4545-af12-2d6112583945', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927bbc20-edce-4860-9b05-05b57c1b5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927bbc20-edce-4860-9b05-05b57c1b5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141cd919-b854-4478-9b54-8443c36a62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:53:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Volume 3083ac50-f1ad-4545-af12-2d6112583945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3083ac50-f1ad-4545-af12-2d6112583945', 'volume_size': 1} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:53:59 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 Sep 02 12:53:59 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:53:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (81034e1c-a836-4e83-9796-f788ced36d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33669914-9588-465f-a972-766c1e605100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33669914-9588-465f-a972-766c1e605100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881982958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075a16f-61f4-414f-988f-a2d454e00c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:00Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0add7ab-dc27-4264-b29f-c4feb213105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0add7ab-dc27-4264-b29f-c4feb213105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af090819-d40a-4571-b468-bc3b8961d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af090819-d40a-4571-b468-bc3b8961d12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3075a16f-61f4-414f-988f-a2d454e00c44', 'volume_name': 'volume-3075a16f-61f4-414f-988f-a2d454e00c44', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392cfa9f-0919-4e78-bb03-e2857962f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392cfa9f-0919-4e78-bb03-e2857962f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31078736-4214-493d-b50c-8ae5a9f33040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Volume 3075a16f-61f4-414f-988f-a2d454e00c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3075a16f-61f4-414f-988f-a2d454e00c44', 'volume_size': 1} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:00 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" returned: 0 in 0.552s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-116257084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3083ac50-f1ad-4545-af12-2d6112583945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:53:59Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Creating volume 3083ac50-f1ad-4545-af12-2d6112583945 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c556a17-4618-48ac-a09f-eef4c50219c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5948df-703a-4fff-ac83-7eda1849f53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 1073741824 Sep 02 12:54:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Volume volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 (d4f01014-e9e8-4fb7-9012-f68d6e0a7b37): created successfully Sep 02 12:54:00 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5948df-703a-4fff-ac83-7eda1849f53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Flow 'volume_create_manager' (1596e3fb-660a-48a2-a3e5-e8c6ff993535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d723e2cd-df94-48bc-a9c1-801610d9ba41 tempest-GroupsTest-22283910 None] Created volume successfully. Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (99a9c9ec-8e96-4f32-b72a-c25dd9a3f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da86114-68a8-4555-8f0c-079001c83410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da86114-68a8-4555-8f0c-079001c83410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1353132017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9af3e4-bbb6-46fd-b090-e20fd1807caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:00Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5929f0f3-4939-4bdc-a1be-15e46d4e57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5929f0f3-4939-4bdc-a1be-15e46d4e57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bf8da1-7cc1-46f2-9071-970c057cdc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bf8da1-7cc1-46f2-9071-970c057cdc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9af3e4-bbb6-46fd-b090-e20fd1807caf', 'volume_name': 'volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c55a629-964a-4e29-a33d-2785d2763912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c55a629-964a-4e29-a33d-2785d2763912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec376192-6d66-4043-8e7d-50ab167b86dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Volume 1d9af3e4-bbb6-46fd-b090-e20fd1807caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf', 'volume_size': 1} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (f2eee599-d355-4a90-9412-9e26e46ed57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a50b55-d7c2-44da-bf59-c08822d96468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a50b55-d7c2-44da-bf59-c08822d96468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1376361090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3c56df-b3df-4812-962a-45fd019add52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:01Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a6c036-52a6-43fd-a44e-440a87eae5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a6c036-52a6-43fd-a44e-440a87eae5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20565f6-1fba-4ee3-8e98-30fea66098da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20565f6-1fba-4ee3-8e98-30fea66098da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3c56df-b3df-4812-962a-45fd019add52', 'volume_name': 'volume-be3c56df-b3df-4812-962a-45fd019add52', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdf4c4d-f1a3-450f-9b6f-da5a6fc4686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdf4c4d-f1a3-450f-9b6f-da5a6fc4686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eecc64e-487e-43ef-8c06-6bda5c41909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Volume be3c56df-b3df-4812-962a-45fd019add52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3c56df-b3df-4812-962a-45fd019add52', 'volume_size': 1} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 1073741824" returned: 0 in 0.963s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:01 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 Sep 02 12:54:01 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (c5d594ef-c3d0-4da7-a6ad-3049cd54c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291f8a3-b481-44b3-a647-54163f5c216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-608aa4d5-321f-405c-8a7a-edd74c9ebef7 tempest-GroupsTest-22283910 None] Update group completed successfully. Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291f8a3-b481-44b3-a647-54163f5c216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1451376501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864950e-79c2-45e8-9e79-e803415277b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:02Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8e5e03-e98b-4a04-9c66-0817e28d3d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8e5e03-e98b-4a04-9c66-0817e28d3d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259149a5-9011-4801-8d29-6e775b438a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259149a5-9011-4801-8d29-6e775b438a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c864950e-79c2-45e8-9e79-e803415277b2', 'volume_name': 'volume-c864950e-79c2-45e8-9e79-e803415277b2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efaba38-5267-4a4f-8bc8-c0f7c86af5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efaba38-5267-4a4f-8bc8-c0f7c86af5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996db75d-3b70-4017-95f1-f07b01233079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Volume c864950e-79c2-45e8-9e79-e803415277b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c864950e-79c2-45e8-9e79-e803415277b2', 'volume_size': 1} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:01 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945" returned: 0 in 0.609s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881982958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3075a16f-61f4-414f-988f-a2d454e00c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:00Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Creating volume 3075a16f-61f4-414f-988f-a2d454e00c44 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141cd919-b854-4478-9b54-8443c36a62e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3083ac50-f1ad-4545-af12-2d6112583945', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcc0c08-5da8-4b38-ab92-e5b86a011328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:01 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 1073741824 Sep 02 12:54:01 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Volume volume-3083ac50-f1ad-4545-af12-2d6112583945 (3083ac50-f1ad-4545-af12-2d6112583945): created successfully Sep 02 12:54:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcc0c08-5da8-4b38-ab92-e5b86a011328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (0cbb36e8-2625-4d47-a461-c06ced237a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-beef604a-fd21-4a91-9047-8f8573f8fe67 tempest-CreateVolumesFromImageTest-211087558 None] Created volume successfully. Sep 02 12:54:02 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 1073741824" returned: 0 in 0.705s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:02 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 Sep 02 12:54:02 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=250,cinder:SELECT=189,cinder:DELETE=22,cinder:INSERT=62 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:54:03 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7ca31ea3-f654-49d0-8b7d-cc312222ae5f tempest-GroupsTest-22283910 None] Update group completed successfully. Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44" returned: 0 in 0.555s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1353132017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9af3e4-bbb6-46fd-b090-e20fd1807caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:00Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Creating volume 1d9af3e4-bbb6-46fd-b090-e20fd1807caf {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31078736-4214-493d-b50c-8ae5a9f33040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3075a16f-61f4-414f-988f-a2d454e00c44', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:03 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf 1073741824 Sep 02 12:54:03 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec933b0-ca56-4a6b-a668-1e7b30c125b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Volume volume-3075a16f-61f4-414f-988f-a2d454e00c44 (3075a16f-61f4-414f-988f-a2d454e00c44): created successfully Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec933b0-ca56-4a6b-a668-1e7b30c125b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (81034e1c-a836-4e83-9796-f788ced36d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0af35879-2bce-46bb-9238-96bf89e03941 tempest-CreateVolumesFromImageTest-211087558 None] Created volume successfully. Sep 02 12:54:03 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf 1073741824" returned: 0 in 0.580s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:03 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf Sep 02 12:54:03 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:04 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1376361090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3c56df-b3df-4812-962a-45fd019add52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:01Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Creating volume be3c56df-b3df-4812-962a-45fd019add52 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:04 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec376192-6d66-4043-8e7d-50ab167b86dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0283e15-04fb-446b-ad92-ed1a006f151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:04 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 1073741824 Sep 02 12:54:04 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Volume volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf (1d9af3e4-bbb6-46fd-b090-e20fd1807caf): created successfully Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0283e15-04fb-446b-ad92-ed1a006f151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (99a9c9ec-8e96-4f32-b72a-c25dd9a3f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-afe6b0ac-84ec-46c7-8cb9-efe59d277dc4 tempest-CreateVolumesFromImageTest-211087558 None] Created volume successfully. Sep 02 12:54:05 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 1073741824" returned: 0 in 0.798s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:05 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 Sep 02 12:54:05 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Acquiring lock "cinder-quobyte-7697a141-8789-4a0f-b732-f93ba1c6ea28" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-7697a141-8789-4a0f-b732-f93ba1c6ea28" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e919b-7b13-463b-a46e-21bc4d47af63]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:05 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.669s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1451376501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864950e-79c2-45e8-9e79-e803415277b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f802587ff7948288434e3ce16a2c9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:02Z,use_quota=True,user_id='57de21e21d5f4fbe95dfcf09a46798d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Creating volume c864950e-79c2-45e8-9e79-e803415277b2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:05 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 Sep 02 12:54:05 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eecc64e-487e-43ef-8c06-6bda5c41909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3c56df-b3df-4812-962a-45fd019add52', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:05 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 1073741824 Sep 02 12:54:05 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385ff7f1-eeac-4bac-bc04-811c0e733f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Volume volume-be3c56df-b3df-4812-962a-45fd019add52 (be3c56df-b3df-4812-962a-45fd019add52): created successfully Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385ff7f1-eeac-4bac-bc04-811c0e733f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (f2eee599-d355-4a90-9412-9e26e46ed57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3cc99407-08ea-4d3e-a079-98b41844e924 tempest-CreateVolumesFromImageTest-211087558 None] Created volume successfully. Sep 02 12:54:06 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28" returned: 0 in 0.813s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:06 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28 Sep 02 12:54:06 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:06 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 1073741824" returned: 0 in 1.004s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:06 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 Sep 02 12:54:06 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:06 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7697a141-8789-4a0f-b732-f93ba1c6ea28" returned: 0 in 0.527s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-7697a141-8789-4a0f-b732-f93ba1c6ea28" released by "delete_volume" :: held 1.459s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Acquiring lock "cinder-quobyte-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598b24d-875b-47d1-8f65-0a64a725f0a0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:07 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 Sep 02 12:54:07 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:07 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2" returned: 0 in 0.509s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996db75d-3b70-4017-95f1-f07b01233079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c864950e-79c2-45e8-9e79-e803415277b2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872fc6a5-47de-49df-80e7-a79529fe0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Volume volume-c864950e-79c2-45e8-9e79-e803415277b2 (c864950e-79c2-45e8-9e79-e803415277b2): created successfully Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872fc6a5-47de-49df-80e7-a79529fe0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Flow 'volume_create_manager' (c5d594ef-c3d0-4da7-a6ad-3049cd54c763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b1564903-ebfc-41d7-84d9-00c1a088439c tempest-CreateVolumesFromImageTest-211087558 None] Created volume successfully. Sep 02 12:54:07 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" returned: 0 in 0.737s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:07 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37 Sep 02 12:54:07 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:08 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "cinder-quobyte-d4f01014-e9e8-4fb7-9012-f68d6e0a7b37" released by "delete_volume" :: held 1.262s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Created reservations ['e4d5e0d3-a603-43f4-8398-be58367c0186'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:08 devstack cinder-volume[87092]: WARNING cinder.quota [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1914706370 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1914706370, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:54:08 devstack cinder-volume[87092]: WARNING cinder.quota [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1914706370 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1914706370, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Created reservations ['835c7d5e-1a5d-4edd-8154-de843093ba82', 'd2016e14-4bba-4435-99e7-80a9883c84c3', '57075979-c70b-4e83-bbfc-f6aaf1b54b53', '5ca02951-9c1f-4d15-a61f-c88d1488483a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-c864950e-79c2-45e8-9e79-e803415277b2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Created reservations ['8443a8f2-95f3-4fe6-83b1-2ad9aad9caab', '9643aac0-503c-4e26-9ccc-d735d0010069', '5c20fe67-de8e-4dac-b5ad-4566d70fb570', '595a9a20-2f77-4ba5-89c9-f811ed8c25ef'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-c864950e-79c2-45e8-9e79-e803415277b2-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-quobyte-c864950e-79c2-45e8-9e79-e803415277b2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-c864950e-79c2-45e8-9e79-e803415277b2" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a87af6-0240-43a0-9677-f61bbf226e53]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:09 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 Sep 02 12:54:09 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:09 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:09 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:09 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:09 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2 Sep 02 12:54:09 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:09 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-58f5aaf7-5bb0-4502-9263-67ac57a14e41 tempest-GroupsTest-22283910 None] Delete group completed successfully. Sep 02 12:54:09 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c864950e-79c2-45e8-9e79-e803415277b2" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-c864950e-79c2-45e8-9e79-e803415277b2" released by "delete_volume" :: held 1.075s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Created reservations ['522b4362-4856-408b-8b24-e457a9547e8d', '43ef0863-a389-4a8b-b0e7-24086d51513e', '636665bb-94c0-41c2-978c-8a90e5f847be', 'd9677d9d-42ef-4cc5-9e6f-64edc041980c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:10 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:10 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba57d61f-774d-44cb-891f-897e3bf5cc28 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba57d61f-774d-44cb-891f-897e3bf5cc28 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" acquired by "attach_volume" :: waited 0.069s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ba57d61f-774d-44cb-891f-897e3bf5cc28 tempest-VolumesActionsTest-2003327171 None] Attaching volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640 to instance 41179af7-7c0a-421f-bcdb-c97b19d18ba8 at mountpoint /dev/vdb on host None. Sep 02 12:54:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ba57d61f-774d-44cb-891f-897e3bf5cc28 tempest-VolumesActionsTest-2003327171 None] Attach volume completed successfully. Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba57d61f-774d-44cb-891f-897e3bf5cc28 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" released by "attach_volume" :: held 0.177s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:10 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Deleted volume successfully. Sep 02 12:54:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e6c5e4-71a2-4967-8434-d277a9103c12 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-c864950e-79c2-45e8-9e79-e803415277b2-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-385cf81e-95a5-4dd0-95c8-af837a111547 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-385cf81e-95a5-4dd0-95c8-af837a111547 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-385cf81e-95a5-4dd0-95c8-af837a111547 tempest-VolumesActionsTest-2003327171 None] Detaching volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640 from instance 41179af7-7c0a-421f-bcdb-c97b19d18ba8. Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-be3c56df-b3df-4812-962a-45fd019add52-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-be3c56df-b3df-4812-962a-45fd019add52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-385cf81e-95a5-4dd0-95c8-af837a111547 tempest-VolumesActionsTest-2003327171 None] Detach volume completed successfully. Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-quobyte-be3c56df-b3df-4812-962a-45fd019add52" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-385cf81e-95a5-4dd0-95c8-af837a111547 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" released by "detach_volume" :: held 0.173s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-be3c56df-b3df-4812-962a-45fd019add52" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025eec2-02f1-47d8-8b5b-d345062c3784]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:11 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 Sep 02 12:54:11 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:11 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52" returned: 0 in 0.637s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:12 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52 Sep 02 12:54:12 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:12 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-be3c56df-b3df-4812-962a-45fd019add52" returned: 0 in 0.576s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-be3c56df-b3df-4812-962a-45fd019add52" released by "delete_volume" :: held 1.302s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Created reservations ['6cd8a524-a507-489a-bd86-bde05e328c4c', 'c4e779ec-0cae-479e-a608-103324967d2a', '565fda4f-b5b8-4ea2-82dc-96c4485fe1ac', '6fcd01df-7b58-4c7b-b49e-f57f8d27bac4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:12 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:12 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:13 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.338s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Deleted volume successfully. Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c653c883-cef5-4e95-9eeb-e226f979b41e tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-be3c56df-b3df-4812-962a-45fd019add52-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-1d9af3e4-bbb6-46fd-b090-e20fd1807caf-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-1d9af3e4-bbb6-46fd-b090-e20fd1807caf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-quobyte-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cbe9f2-a0f3-43b7-afab-e810d7d0b2a1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:13 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf Sep 02 12:54:13 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:14 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" returned: 0 in 0.581s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:14 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf Sep 02 12:54:14 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:14 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-1d9af3e4-bbb6-46fd-b090-e20fd1807caf" released by "delete_volume" :: held 0.977s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Created reservations ['dcfcfb54-cb15-4ae3-a6d0-fa1a97794ebf', '5f44c967-99eb-4659-a146-cc1edd41afac', 'dc55b831-e41b-462a-af4b-c1672f91a4bc', '898a7dc4-51d6-48a5-88b4-1c7d4a954566'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:14 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:14 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:15 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:15 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Deleted volume successfully. Sep 02 12:54:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae5b449c-c7f1-4983-84a4-000cac542d32 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-1d9af3e4-bbb6-46fd-b090-e20fd1807caf-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-3075a16f-61f4-414f-988f-a2d454e00c44-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-3075a16f-61f4-414f-988f-a2d454e00c44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-quobyte-3075a16f-61f4-414f-988f-a2d454e00c44" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-3075a16f-61f4-414f-988f-a2d454e00c44" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b681e0e-501e-4703-858e-d61b3afad71e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:16 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 Sep 02 12:54:16 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:16 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44" returned: 0 in 0.464s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:16 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44 Sep 02 12:54:16 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:16 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3075a16f-61f4-414f-988f-a2d454e00c44" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-3075a16f-61f4-414f-988f-a2d454e00c44" released by "delete_volume" :: held 0.833s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Created reservations ['7aa1403c-c342-4d42-b886-d3192fc8b499', '0a58582a-ed42-42fb-bdb9-eb2f29a94ea6', '1ab623da-d56c-4234-b8ee-b00fb002e9bc', 'eb4bcc29-a818-4a43-8f14-cce0c7cd8596'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:17 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:17 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-3083ac50-f1ad-4545-af12-2d6112583945-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-3083ac50-f1ad-4545-af12-2d6112583945-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "cinder-quobyte-3083ac50-f1ad-4545-af12-2d6112583945" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-3083ac50-f1ad-4545-af12-2d6112583945" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7df29-a051-4dec-b1d2-996412750879]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:17 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Deleted volume successfully. Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1488cec-9ea6-41d7-b642-932f6ee2eaac tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-3075a16f-61f4-414f-988f-a2d454e00c44-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:17 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 Sep 02 12:54:17 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:17 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945" returned: 0 in 0.571s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:18 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945 Sep 02 12:54:18 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:18 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-3083ac50-f1ad-4545-af12-2d6112583945" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-quobyte-3083ac50-f1ad-4545-af12-2d6112583945" released by "delete_volume" :: held 1.060s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Created reservations ['6537d101-7927-4aa8-b708-934d5d832ac5', 'd01ff07a-212a-486f-878a-6e8d460240b2', 'd9d2faf0-8696-4534-ac5f-48ecc1ec329d', 'a750dd11-bf68-42b2-b629-8cb38a8678f6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:18 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:18 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:19 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:19 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Deleted volume successfully. Sep 02 12:54:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c508a189-1602-4477-9e3c-4d3c61537918 tempest-CreateVolumesFromImageTest-211087558 None] Lock "cinder-3083ac50-f1ad-4545-af12-2d6112583945-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=101,cinder:INSERT=33,cinder:UPDATE=125,cinder:DELETE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:54:29 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=72,cinder:SELECT=45,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:54:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d01c0514-6150-4639-ad16-3f4a1d6e39d3 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d01c0514-6150-4639-ad16-3f4a1d6e39d3 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" acquired by "attach_volume" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d01c0514-6150-4639-ad16-3f4a1d6e39d3 tempest-VolumesActionsTest-2003327171 None] Attaching volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640 to instance f9acd8e5-78d1-4160-9b61-13f6ee603f34 at mountpoint /dev/vdb on host None. Sep 02 12:54:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d01c0514-6150-4639-ad16-3f4a1d6e39d3 tempest-VolumesActionsTest-2003327171 None] Attach volume completed successfully. Sep 02 12:54:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d01c0514-6150-4639-ad16-3f4a1d6e39d3 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640" released by "attach_volume" :: held 0.185s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7771b7cd-9f8c-4605-a4ab-77b938ee8200 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:54:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7771b7cd-9f8c-4605-a4ab-77b938ee8200 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:54:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7771b7cd-9f8c-4605-a4ab-77b938ee8200 tempest-VolumesActionsTest-2003327171 None] Detaching volume 0773ea04-9ca0-4e2c-a4cb-157b53d78640 from instance f9acd8e5-78d1-4160-9b61-13f6ee603f34. Sep 02 12:54:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7771b7cd-9f8c-4605-a4ab-77b938ee8200 tempest-VolumesActionsTest-2003327171 None] Detach volume completed successfully. Sep 02 12:54:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7771b7cd-9f8c-4605-a4ab-77b938ee8200 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (2a693bb9-c7d0-4d61-82b2-67cc402d34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b376b7-4782-4b48-b736-14ff543d1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b376b7-4782-4b48-b736-14ff543d1793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1858384725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd2f490-af5e-4cae-becf-2be547757f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:34Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4472f3c-5278-43ab-a9b9-ce79d4147eb9),volume_type_id=a4472f3c-5278-43ab-a9b9-ce79d4147eb9)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c462d1d-6eb5-48e0-b4b4-c164cea53672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c462d1d-6eb5-48e0-b4b4-c164cea53672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56bb84b-1599-4146-a98f-b044f008b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56bb84b-1599-4146-a98f-b044f008b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd2f490-af5e-4cae-becf-2be547757f11', 'volume_name': 'volume-4dd2f490-af5e-4cae-becf-2be547757f11', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bfe760-0552-436c-ab0e-eac043e5fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bfe760-0552-436c-ab0e-eac043e5fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d345b2d-09b6-4af2-901d-b9ea7073dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume 4dd2f490-af5e-4cae-becf-2be547757f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd2f490-af5e-4cae-becf-2be547757f11', 'volume_size': 1} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1858384725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd2f490-af5e-4cae-becf-2be547757f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:34Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4472f3c-5278-43ab-a9b9-ce79d4147eb9),volume_type_id=a4472f3c-5278-43ab-a9b9-ce79d4147eb9)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Creating volume 4dd2f490-af5e-4cae-becf-2be547757f11 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:33 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 1073741824 Sep 02 12:54:33 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:34 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (50e13199-2609-4b29-8cb2-baa09e7a35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53af03c4-eaa2-4bfb-976b-aaeeeb37efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 1073741824" returned: 0 in 0.667s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53af03c4-eaa2-4bfb-976b-aaeeeb37efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784988448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b3189-5387-47d0-81d6-7f31a0d84df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:34Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7676395a-7774-41b6-8ce0-a7a30a046427),volume_type_id=7676395a-7774-41b6-8ce0-a7a30a046427)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f8a1d4-e38c-42d9-8210-32aef64f2249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f8a1d4-e38c-42d9-8210-32aef64f2249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429962c9-87c7-4807-b3c7-b0d5f15a1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429962c9-87c7-4807-b3c7-b0d5f15a1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7b3189-5387-47d0-81d6-7f31a0d84df7', 'volume_name': 'volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bace4da-f516-4d25-a286-26824d939f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bace4da-f516-4d25-a286-26824d939f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a94022-bfda-4661-8a67-76be0eec4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume 9b7b3189-5387-47d0-81d6-7f31a0d84df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7', 'volume_size': 1} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:34 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 Sep 02 12:54:34 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:34 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784988448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7b3189-5387-47d0-81d6-7f31a0d84df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:34Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7676395a-7774-41b6-8ce0-a7a30a046427),volume_type_id=7676395a-7774-41b6-8ce0-a7a30a046427)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Creating volume 9b7b3189-5387-47d0-81d6-7f31a0d84df7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:54:35 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d345b2d-09b6-4af2-901d-b9ea7073dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd2f490-af5e-4cae-becf-2be547757f11', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce347b0-3e46-416a-979d-c4c739554662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:35 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 1073741824 Sep 02 12:54:35 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume volume-4dd2f490-af5e-4cae-becf-2be547757f11 (4dd2f490-af5e-4cae-becf-2be547757f11): created successfully Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce347b0-3e46-416a-979d-c4c739554662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (2a693bb9-c7d0-4d61-82b2-67cc402d34e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-be4cea7c-fc57-4dfb-ab9c-2a0a69d93bb8 tempest-TestInstancesWithCinderVolumes-1969036388 None] Created volume successfully. Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (4702e89a-f125-46d4-afb3-b81ce63a4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaeb800-f7b5-4e30-bbe1-06dfb226f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaeb800-f7b5-4e30-bbe1-06dfb226f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-311187139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1edc14-d54a-420a-865d-53984cd9a486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:35Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87afa211-ec39-42ff-b544-3412e1f3e1f7),volume_type_id=87afa211-ec39-42ff-b544-3412e1f3e1f7)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41bd5a0-c27f-4d23-b496-cb3d1a220f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41bd5a0-c27f-4d23-b496-cb3d1a220f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45841045-1ac7-4abd-aec9-bf000b74c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:54:35 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 1073741824" returned: 0 in 0.679s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:35 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 Sep 02 12:54:35 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:36 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a94022-bfda-4661-8a67-76be0eec4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ecfd2d-a85a-462b-8220-1cb75ece84b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 (9b7b3189-5387-47d0-81d6-7f31a0d84df7): created successfully Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ecfd2d-a85a-462b-8220-1cb75ece84b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (50e13199-2609-4b29-8cb2-baa09e7a35ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7a76451b-8a47-4f89-8ad6-118d2fd28d19 tempest-TestInstancesWithCinderVolumes-1969036388 None] Created volume successfully. Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45841045-1ac7-4abd-aec9-bf000b74c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec1edc14-d54a-420a-865d-53984cd9a486', 'volume_name': 'volume-ec1edc14-d54a-420a-865d-53984cd9a486', 'volume_size': 1, 'image_id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1191121859', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ab1fa6fb4004b0cafd48a2fbf3582fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'created_at': datetime.datetime(2026, 9, 2, 10, 54, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 54, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30435ba7-fb7a-4b9a-85c8-0980cbbd6499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30435ba7-fb7a-4b9a-85c8-0980cbbd6499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397db2e9-48fa-4ac9-ad64-985b221d9186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume ec1edc14-d54a-420a-865d-53984cd9a486: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec1edc14-d54a-420a-865d-53984cd9a486', 'volume_size': 1, 'image_id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1191121859', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ab1fa6fb4004b0cafd48a2fbf3582fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'created_at': datetime.datetime(2026, 9, 2, 10, 54, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 54, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9/file', 'properties': {}}, 'image_service': } Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Trying to clone ec1edc14-d54a-420a-865d-53984cd9a486 from image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a274d0-8096-462d-bde4-0b86e9a975b3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:36 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:54:36 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:37 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.523s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e4bdd-bcd7-4c02-82ef-a6292cb98505]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (5d10be31-455f-4856-926b-7f8a8ea0140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41247d5a-f346-402b-b055-2f339192550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41247d5a-f346-402b-b055-2f339192550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067846577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fcbce8-b847-40c9-b22d-792ae8d5a17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:37Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe1c73-e8d1-4068-9e2d-9d7b6751bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe1c73-e8d1-4068-9e2d-9d7b6751bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995cc384-4dab-4db1-8a0a-9441fe889d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995cc384-4dab-4db1-8a0a-9441fe889d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fcbce8-b847-40c9-b22d-792ae8d5a17e', 'volume_name': 'volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374234e2-459e-4783-884b-594b3fab8eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374234e2-459e-4783-884b-594b3fab8eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfec825-55ec-4407-aa97-c3bd8298e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Volume 72fcbce8-b847-40c9-b22d-792ae8d5a17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e', 'volume_size': 1} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:54:37 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:54:37 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:37 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:54:37 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:37 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.4843e79f-403b-492a-969a-9e395be7f2bfbxeekjqa.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:37 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.4843e79f-403b-492a-969a-9e395be7f2bfbxeekjqa.img Sep 02 12:54:37 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:37 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:54:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:54:41 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:54:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Flow 'volume_create_manager' (9b7fee36-c808-405a-b702-68646e1f5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:54:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01ab2f-9223-41f5-a665-b164e0ae7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01ab2f-9223-41f5-a665-b164e0ae7902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-603680710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e2f83f-2214-4ee7-9a35-7df8aff55bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5787d792f18472c9c3b686c799a12b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:42Z,use_quota=True,user_id='033acf4d488648d9afa1fa293e9a5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6db9973-9a2b-452d-ae2d-1414bb9742d5),volume_type_id=f6db9973-9a2b-452d-ae2d-1414bb9742d5)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54966e-5066-46d1-a7e2-b05c198e5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54966e-5066-46d1-a7e2-b05c198e5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1c8d6c-17b6-447b-adde-41d130be0273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1c8d6c-17b6-447b-adde-41d130be0273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e2f83f-2214-4ee7-9a35-7df8aff55bad', 'volume_name': 'volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1d0f24-9646-43d9-8e72-f721e63591a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1d0f24-9646-43d9-8e72-f721e63591a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe74916-0fc7-41c4-bbc3-4c1256a5ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:54:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Volume 32e2f83f-2214-4ee7-9a35-7df8aff55bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad', 'volume_size': 1} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD, size 20.69 MB, duration 6.49 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:54:42 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Image download 20.69 MB at 3.19 MB/s Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75a3ba-0e64-43bc-a1d9-ad51ffe2befb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:43 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.4843e79f-403b-492a-969a-9e395be7f2bfbxeekjqa.img" returned: 0 in 5.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25c2d5-514e-4002-933c-59409e9f2f1b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:43 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD Sep 02 12:54:43 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:43 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:54:43 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:43 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Temporary image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 is fetched for user e37387f481e24e84b34b492ac0289179. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a15089-00f7-4bfc-951c-872731f6911d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:54:43 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD Sep 02 12:54:43 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:54:43 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.541s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.4843e79f-403b-492a-969a-9e395be7f2bfbxeekjqa.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:54:43 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Converted 1024.00 MB image at 189.29 MB/s Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] 4843e79f-403b-492a-969a-9e395be7f2bf was raw, no need to convert to raw {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 12:54:43 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:54:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:54:53 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:INSERT=4,cinder:SELECT=17,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:54:53 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.110s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Uploaded volume to glance image-id: 4843e79f-403b-492a-969a-9e395be7f2bf. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.441s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067846577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fcbce8-b847-40c9-b22d-792ae8d5a17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:37Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Creating volume 72fcbce8-b847-40c9-b22d-792ae8d5a17e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:01 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e 1073741824 Sep 02 12:55:01 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-970d8ff1-d238-4fe0-bedb-8c89514a9a73 tempest-VolumesActionsTest-2003327171 None] Copy volume to image completed successfully. Sep 02 12:55:02 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e 1073741824" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:02 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e Sep 02 12:55:02 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:02 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.436s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-603680710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e2f83f-2214-4ee7-9a35-7df8aff55bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5787d792f18472c9c3b686c799a12b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:42Z,use_quota=True,user_id='033acf4d488648d9afa1fa293e9a5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6db9973-9a2b-452d-ae2d-1414bb9742d5),volume_type_id=f6db9973-9a2b-452d-ae2d-1414bb9742d5)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Creating volume 32e2f83f-2214-4ee7-9a35-7df8aff55bad {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:02 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad 1073741824 Sep 02 12:55:02 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfec825-55ec-4407-aa97-c3bd8298e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626264c6-cd6c-4923-8384-5615caf65e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Volume volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e (72fcbce8-b847-40c9-b22d-792ae8d5a17e): created successfully Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626264c6-cd6c-4923-8384-5615caf65e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (5d10be31-455f-4856-926b-7f8a8ea0140a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ed043a82-00a9-4f91-bda4-63b012093c76 tempest-ProjectReaderTests-2044523241 None] Created volume successfully. Sep 02 12:55:03 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad 1073741824" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:03 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad Sep 02 12:55:03 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:03 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.574s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-311187139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1edc14-d54a-420a-865d-53984cd9a486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab1fa6fb4004b0cafd48a2fbf3582fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:54:35Z,use_quota=True,user_id='e37387f481e24e84b34b492ac0289179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87afa211-ec39-42ff-b544-3412e1f3e1f7),volume_type_id=87afa211-ec39-42ff-b544-3412e1f3e1f7)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Creating volume ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe74916-0fc7-41c4-bbc3-4c1256a5ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600c0baa-a8a2-4b2a-975b-283129b43c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:03 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1073741824 Sep 02 12:55:03 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Volume volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad (32e2f83f-2214-4ee7-9a35-7df8aff55bad): created successfully Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600c0baa-a8a2-4b2a-975b-283129b43c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Flow 'volume_create_manager' (9b7fee36-c808-405a-b702-68646e1f5e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5c2ecc3f-f6b5-46b0-9f9a-aeb7dad09c4b tempest-VolumeTypesAccessTest-930588694 None] Created volume successfully. Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-72fcbce8-b847-40c9-b22d-792ae8d5a17e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-72fcbce8-b847-40c9-b22d-792ae8d5a17e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-quobyte-72fcbce8-b847-40c9-b22d-792ae8d5a17e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-72fcbce8-b847-40c9-b22d-792ae8d5a17e" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9d66a-3fce-4acb-92e8-25a01c5e2df8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:03 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e Sep 02 12:55:03 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:03 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1073741824" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:03 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 Sep 02 12:55:03 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e" returned: 0 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e Sep 02 12:55:04 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.396s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a0af4-efac-4d99-b39d-0266e16b8993]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Attempting download of 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}])) to volume ec1edc14-d54a-420a-865d-53984cd9a486. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a66857f-ad73-4397-b6b7-a26aec27495c]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:55:04 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-72fcbce8-b847-40c9-b22d-792ae8d5a17e" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-72fcbce8-b847-40c9-b22d-792ae8d5a17e" released by "delete_volume" :: held 0.752s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:04 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9 Sep 02 12:55:04 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Created reservations ['bcaaa7e0-bdb0-41b6-8a2e-adfc835ea28a', '7d73120e-c98b-4e4e-bbf9-8d29269f09ff', '4280aedb-6c77-4ad0-994f-4ab155df60ea', '962b9005-7729-42d8-9bc3-01d96cca2366'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Acquiring lock "cinder-32e2f83f-2214-4ee7-9a35-7df8aff55bad-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "cinder-32e2f83f-2214-4ee7-9a35-7df8aff55bad-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:04 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:04 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Acquiring lock "cinder-quobyte-32e2f83f-2214-4ee7-9a35-7df8aff55bad" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed45b4-955a-4d9b-af23-99a2248ec076]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "cinder-quobyte-32e2f83f-2214-4ee7-9a35-7df8aff55bad" acquired by "delete_volume" :: waited 0.046s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:04 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9691657-3e0e-4130-939c-b74e82c2f6cf]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9" returned: 0 in 0.458s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:04 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:55:04 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9 Sep 02 12:55:04 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad Sep 02 12:55:04 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:04 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Deleted volume successfully. Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8e3e727a-8e4e-4af1-8d58-3cb934264298 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-72fcbce8-b847-40c9-b22d-792ae8d5a17e-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:05 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:05 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img Sep 02 12:55:05 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:05 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9" returned: 1 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_gxm3k0u9' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c68fc2-1b02-4834-ab0d-66cc01dd7acc]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:05 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:05 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD Sep 02 12:55:05 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:05 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad Sep 02 12:55:05 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (37c13f57-fa46-4e24-a026-256d255995b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237bdd0a-dcd7-4dd2-86a1-551b27ced21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237bdd0a-dcd7-4dd2-86a1-551b27ced21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079657133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5fa428-0157-4ede-b46a-2e09b5a86f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:05Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404dd9d1-c370-46eb-a7ae-3c0659fcf84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404dd9d1-c370-46eb-a7ae-3c0659fcf84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c40cd37-cc0d-458e-b755-1c417f8f2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c40cd37-cc0d-458e-b755-1c417f8f2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5fa428-0157-4ede-b46a-2e09b5a86f00', 'volume_name': 'volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed99cf-14bd-4397-93f5-10f8f1b65428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed99cf-14bd-4397-93f5-10f8f1b65428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530d851-60e2-49b6-acb4-f5c9a6b3e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Volume fd5fa428-0157-4ede-b46a-2e09b5a86f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00', 'volume_size': 1} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:05 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-32e2f83f-2214-4ee7-9a35-7df8aff55bad" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "cinder-quobyte-32e2f83f-2214-4ee7-9a35-7df8aff55bad" released by "delete_volume" :: held 1.040s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:05 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD" returned: 0 in 0.634s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:05 devstack cinder-volume[87092]: WARNING cinder.quota [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-8060842 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-8060842, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:55:05 devstack cinder-volume[87092]: WARNING cinder.quota [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-8060842 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-8060842, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:55:05 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 Sep 02 12:55:05 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:05 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Created reservations ['801d01e1-5895-43f9-bf10-3b6f4fa34993', '968445ba-f005-4728-b6f2-f733d0274d54', 'b5298346-14d4-4443-8d6c-8ebd1e0b4fb6', '08017da3-8fc8-4506-869f-de263ddb43af'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:06 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:06 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:06 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.730s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:06 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Deleted volume successfully. Sep 02 12:55:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53a5c6b1-e4f6-49de-8850-e7659a7d7783 tempest-VolumeTypesAccessTest-930588694 None] Lock "cinder-32e2f83f-2214-4ee7-9a35-7df8aff55bad-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:10 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486" returned: 0 in 4.732s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10ec3cfa-a2f0-4153-b95d-d5f2c89409c9_7qgr4zafdevstack@QuobyteHD, size 112.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:55:10 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Converted 112.00 MB image at 23.66 MB/s Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:10 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1G Sep 02 12:55:10 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:10 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img" returned: 0 in 5.561s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70f807-e7ee-46fb-ae16-f3781de21a89]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:10 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:55:10 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:10 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 1G" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Downloaded image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}])) to volume ec1edc14-d54a-420a-865d-53984cd9a486 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Temporary image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 for user e37387f481e24e84b34b492ac0289179 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:55:10 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Marking volume ec1edc14-d54a-420a-865d-53984cd9a486 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Copying metadata from image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 to ec1edc14-d54a-420a-865d-53984cd9a486. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Creating volume glance metadata for volume ec1edc14-d54a-420a-865d-53984cd9a486 backed by image 10ec3cfa-a2f0-4153-b95d-d5f2c89409c9 with: {'image_id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'image_name': 'tempest-scenario-img--1191121859', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397db2e9-48fa-4ac9-ad64-985b221d9186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1edc14-d54a-420a-865d-53984cd9a486', 'volume_size': 1, 'image_id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1191121859', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ab1fa6fb4004b0cafd48a2fbf3582fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10ec3cfa-a2f0-4153-b95d-d5f2c89409c9', 'created_at': datetime.datetime(2026, 9, 2, 10, 54, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 54, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10ec3cfa-a2f0-4153-b95d-d5f2c89409c9/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39809d2e-f476-447e-b31d-69498e91bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Volume volume-ec1edc14-d54a-420a-865d-53984cd9a486 (ec1edc14-d54a-420a-865d-53984cd9a486): created successfully Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39809d2e-f476-447e-b31d-69498e91bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Flow 'volume_create_manager' (4702e89a-f125-46d4-afb3-b81ce63a4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-16808f4b-6a29-4fe7-9b00-03ef3fa2698a tempest-TestInstancesWithCinderVolumes-1969036388 None] Created volume successfully. Sep 02 12:55:11 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.611s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:55:11 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Converted 1024.00 MB image at 184.10 MB/s Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] d4e0a4e1-69df-499b-ad79-59d72e5f90fa was raw, converting to qcow2 {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a862a2-1a0c-49bc-8e24-56831c780243]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:11 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img Sep 02 12:55:11 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:11 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:11 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img Sep 02 12:55:11 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:12 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img" returned: 1 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:12 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0 Sep 02 12:55:12 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:12 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Image conversion details: src /opt/stack/data/cinder/conversion/0773ea04-9ca0-4e2c-a4cb-157b53d78640.temp_image.d4e0a4e1-69df-499b-ad79-59d72e5f90fax_3bs6fn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:55:12 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4b67f-3ccc-461c-827f-95ed79194bfd]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:12 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0 Sep 02 12:55:12 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:12 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j7x2euu0" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.481s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Uploaded volume to glance image-id: d4e0a4e1-69df-499b-ad79-59d72e5f90fa. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.114s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079657133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5fa428-0157-4ede-b46a-2e09b5a86f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:05Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Creating volume fd5fa428-0157-4ede-b46a-2e09b5a86f00 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:14 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a569f051-543c-4609-b360-056949398335 tempest-VolumesActionsTest-2003327171 None] Copy volume to image completed successfully. Sep 02 12:55:14 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 1073741824 Sep 02 12:55:14 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:15 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 1073741824" returned: 0 in 0.572s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:15 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 Sep 02 12:55:15 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:15 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530d851-60e2-49b6-acb4-f5c9a6b3e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcc62d0-953f-4b50-a5b0-2c4ee62de392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Volume volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 (fd5fa428-0157-4ede-b46a-2e09b5a86f00): created successfully Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcc62d0-953f-4b50-a5b0-2c4ee62de392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (37c13f57-fa46-4e24-a026-256d255995b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef0a767d-e825-4137-8355-6aa2de6796a1 tempest-ProjectReaderTests-2044523241 None] Created volume successfully. Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3213dacb-a39d-4e44-a285-8a6f1818cd0f req-6ea7ac1d-ab1a-4c56-bf0c-911626d86a43 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3213dacb-a39d-4e44-a285-8a6f1818cd0f req-6ea7ac1d-ab1a-4c56-bf0c-911626d86a43 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3213dacb-a39d-4e44-a285-8a6f1818cd0f req-6ea7ac1d-ab1a-4c56-bf0c-911626d86a43 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-3213dacb-a39d-4e44-a285-8a6f1818cd0f req-6ea7ac1d-ab1a-4c56-bf0c-911626d86a43 tempest-TestInstancesWithCinderVolumes-1969036388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-ec1edc14-d54a-420a-865d-53984cd9a486', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39d742c7-3256-4820-a657-f27e643d9bfe', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:55:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-3213dacb-a39d-4e44-a285-8a6f1818cd0f req-6ea7ac1d-ab1a-4c56-bf0c-911626d86a43 tempest-TestInstancesWithCinderVolumes-1969036388 None] attachment_update completed successfully. Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "cinder-quobyte-0773ea04-9ca0-4e2c-a4cb-157b53d78640" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-fd5fa428-0157-4ede-b46a-2e09b5a86f00-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-quobyte-0773ea04-9ca0-4e2c-a4cb-157b53d78640" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-fd5fa428-0157-4ede-b46a-2e09b5a86f00-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee006d46-9fb1-48b8-a510-155eda3561ca]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-quobyte-fd5fa428-0157-4ede-b46a-2e09b5a86f00" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-fd5fa428-0157-4ede-b46a-2e09b5a86f00" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dab899-2201-4ab6-ab02-eca1bdebea50]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:16 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:55:16 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:16 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 Sep 02 12:55:16 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:17 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.580s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:17 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00" returned: 0 in 0.508s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:17 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640 Sep 02 12:55:17 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:17 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00 Sep 02 12:55:17 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:17 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fd5fa428-0157-4ede-b46a-2e09b5a86f00" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-fd5fa428-0157-4ede-b46a-2e09b5a86f00" released by "delete_volume" :: held 0.911s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:17 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0773ea04-9ca0-4e2c-a4cb-157b53d78640" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-quobyte-0773ea04-9ca0-4e2c-a4cb-157b53d78640" released by "delete_volume" :: held 1.062s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Created reservations ['fdd9d163-754f-4b8e-b7fb-cced436d27d8', '3af38e60-905c-4520-a75e-df31b3967e63', '2aa8ccaa-f220-48d8-a1a6-88241c364d08', '7c8f508a-01b5-4aab-9ac4-b39c82aa023a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Created reservations ['ac1285e5-07fc-45ef-b68b-cd1ba5c2ad65', 'ec914f98-3aa5-4bc0-87ce-2987629e5dda', '6d741ae9-7ab9-49f1-bb64-b46e13b9bef6', '9a8488da-f3a9-4c67-b2b7-6c98855e92cf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:17 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:17 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:18 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:18 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:18 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Deleted volume successfully. Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2708a762-2254-4a44-a2ee-a8ad7980ad68 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-fd5fa428-0157-4ede-b46a-2e09b5a86f00-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:18 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.447s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Deleted volume successfully. Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c049bbf7-8df9-436f-96ae-5d55a4aad748 tempest-VolumesActionsTest-2003327171 None] Lock "cinder-0773ea04-9ca0-4e2c-a4cb-157b53d78640-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (2f82e9dc-9ec3-493a-b93f-270d3cee5470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d499bf0-71e5-40cd-b830-88fb5d1c45b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d499bf0-71e5-40cd-b830-88fb5d1c45b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483474247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b68ff4-f7a6-4856-b6e5-85b14a5a6750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:19Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42042697-c363-4109-9205-961465d0d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42042697-c363-4109-9205-961465d0d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dd7a41-7d44-47b5-b016-c8905e5cfd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dd7a41-7d44-47b5-b016-c8905e5cfd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b68ff4-f7a6-4856-b6e5-85b14a5a6750', 'volume_name': 'volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be20a5b5-e7ee-41e0-baae-5a49045f4652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be20a5b5-e7ee-41e0-baae-5a49045f4652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc24c8-b6e2-4c8c-9021-574e9472c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Volume 79b68ff4-f7a6-4856-b6e5-85b14a5a6750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750', 'volume_size': 1} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483474247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b68ff4-f7a6-4856-b6e5-85b14a5a6750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:19Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Creating volume 79b68ff4-f7a6-4856-b6e5-85b14a5a6750 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:18 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 1073741824 Sep 02 12:55:18 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:19 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 1073741824" returned: 0 in 0.545s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:19 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 Sep 02 12:55:19 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:19 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc24c8-b6e2-4c8c-9021-574e9472c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c8b473-0e1c-48ca-bce8-4f2934579e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Volume volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 (79b68ff4-f7a6-4856-b6e5-85b14a5a6750): created successfully Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c8b473-0e1c-48ca-bce8-4f2934579e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (2f82e9dc-9ec3-493a-b93f-270d3cee5470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e924dc0-cfaf-4d57-b1c6-6836c48c4a72 tempest-ProjectReaderTests-2044523241 None] Created volume successfully. Sep 02 12:55:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-79b68ff4-f7a6-4856-b6e5-85b14a5a6750-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-79b68ff4-f7a6-4856-b6e5-85b14a5a6750-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-quobyte-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a86a89-b6d5-4cda-a3b3-cbfeecdd1f1b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:21 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 Sep 02 12:55:21 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:21 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" returned: 0 in 0.813s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:21 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750 Sep 02 12:55:21 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:22 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-79b68ff4-f7a6-4856-b6e5-85b14a5a6750" released by "delete_volume" :: held 1.494s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Created reservations ['96282a4c-2d6b-49a2-937d-608dec35b91e', 'ee228e17-f7ce-4e8a-bb4a-fce9ff9802e3', 'd359a3b2-1403-422e-a44c-981113314276', '6485ffde-85e8-4e2d-b4ec-d53d08b1578b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:23 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:23 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:23 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Deleted volume successfully. Sep 02 12:55:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22a5e2d5-8242-4a7f-a725-479f53ae1130 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-79b68ff4-f7a6-4856-b6e5-85b14a5a6750-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (4980eb80-6974-4e78-8f16-00575c8b6e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c950624c-dddc-4e52-b101-29ab80459718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c950624c-dddc-4e52-b101-29ab80459718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468852301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36728e7c-ea9e-4e39-bdfe-d01aeea4bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:25Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaafa7cc-17d8-42ce-b492-326d406cdbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaafa7cc-17d8-42ce-b492-326d406cdbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d07161f-7017-4713-a2a7-55ff5687f6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d07161f-7017-4713-a2a7-55ff5687f6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36728e7c-ea9e-4e39-bdfe-d01aeea4bc98', 'volume_name': 'volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbb176-8adf-464d-b2e1-2166cf75d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbb176-8adf-464d-b2e1-2166cf75d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7815fd8-a693-49d4-a0a2-afef39231898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Volume 36728e7c-ea9e-4e39-bdfe-d01aeea4bc98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98', 'volume_size': 1} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-468852301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36728e7c-ea9e-4e39-bdfe-d01aeea4bc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a943c0d3a6bc4401993998462d30b435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:25Z,use_quota=True,user_id='b95379a93df84056b26b4637c92053e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Creating volume 36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:24 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:24 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 1073741824 Sep 02 12:55:24 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:25 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 1073741824" returned: 0 in 0.788s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:25 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 Sep 02 12:55:25 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:26 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7815fd8-a693-49d4-a0a2-afef39231898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c5b043-cc6e-47da-ad3a-4767e5a3ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Volume volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 (36728e7c-ea9e-4e39-bdfe-d01aeea4bc98): created successfully Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c5b043-cc6e-47da-ad3a-4767e5a3ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Flow 'volume_create_manager' (4980eb80-6974-4e78-8f16-00575c8b6e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cd634e6e-23bb-4224-8a8c-e4b0f6f1aeaa tempest-ProjectReaderTests-2044523241 None] Created volume successfully. Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "cinder-quobyte-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[49022c15-0196-48b8-bb76-1f41da7564b2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:28 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 Sep 02 12:55:28 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:28 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:28 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98 Sep 02 12:55:28 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:28 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" returned: 0 in 0.414s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-quobyte-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98" released by "delete_volume" :: held 0.906s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Created reservations ['7265279d-f85d-479b-ba8c-9bfad5536f7c', 'a0a1e74d-058d-4b30-a44d-06a61219d032', '172378de-7552-4d10-b216-15d899c74412', 'd8c59418-5a52-46f2-9ef1-3c21f51d8765'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:29 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:29 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:30 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Deleted volume successfully. Sep 02 12:55:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ce41a408-0e06-43aa-9244-8e9ff812d9d3 tempest-ProjectReaderTests-2044523241 None] Lock "cinder-36728e7c-ea9e-4e39-bdfe-d01aeea4bc98-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Flow 'volume_create_manager' (c092c38a-526a-4046-90ce-b6fcc61ba2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2432362e-8119-459d-8840-6548975c618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2432362e-8119-459d-8840-6548975c618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1944939108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c743e113-d8ce-40df-a168-14e793c8cf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0daa6600eb24326a8ef81678dad612f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:33Z,use_quota=True,user_id='b9952c7e757c449cbb238c78b23dc953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5649708-817a-437c-82bf-0b82d2662dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5649708-817a-437c-82bf-0b82d2662dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b6c07-47a3-4588-b084-9303f800ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b6c07-47a3-4588-b084-9303f800ad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c743e113-d8ce-40df-a168-14e793c8cf6c', 'volume_name': 'volume-c743e113-d8ce-40df-a168-14e793c8cf6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b2fcf2-eb9b-44a5-a3ee-782c7553cba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b2fcf2-eb9b-44a5-a3ee-782c7553cba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179b84e1-79f0-4f94-bcf1-73f757f4e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Volume c743e113-d8ce-40df-a168-14e793c8cf6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c743e113-d8ce-40df-a168-14e793c8cf6c', 'volume_size': 1} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1944939108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c743e113-d8ce-40df-a168-14e793c8cf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0daa6600eb24326a8ef81678dad612f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:33Z,use_quota=True,user_id='b9952c7e757c449cbb238c78b23dc953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Creating volume c743e113-d8ce-40df-a168-14e793c8cf6c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:33 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c 1073741824 Sep 02 12:55:33 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:34 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c 1073741824" returned: 0 in 0.949s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:34 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c Sep 02 12:55:34 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:34 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179b84e1-79f0-4f94-bcf1-73f757f4e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c743e113-d8ce-40df-a168-14e793c8cf6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7128f5-64da-477a-93e9-e5562fea88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Volume volume-c743e113-d8ce-40df-a168-14e793c8cf6c (c743e113-d8ce-40df-a168-14e793c8cf6c): created successfully Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7128f5-64da-477a-93e9-e5562fea88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Flow 'volume_create_manager' (c092c38a-526a-4046-90ce-b6fcc61ba2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-80889e0d-cc3c-45ab-972a-95a62b052ae6 tempest-VolumesMetadataTest-1574841997 None] Created volume successfully. Sep 02 12:55:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Acquiring lock "cinder-c743e113-d8ce-40df-a168-14e793c8cf6c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "cinder-c743e113-d8ce-40df-a168-14e793c8cf6c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Acquiring lock "cinder-quobyte-c743e113-d8ce-40df-a168-14e793c8cf6c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "cinder-quobyte-c743e113-d8ce-40df-a168-14e793c8cf6c" acquired by "delete_volume" :: waited 0.053s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f6f38b-c600-4994-bac1-3a4ed5b1501a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:37 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c Sep 02 12:55:37 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (44a3ae19-82f8-4fc2-98c8-f718a1725f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede96be6-9fe3-47ec-b7d6-a4956860c2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede96be6-9fe3-47ec-b7d6-a4956860c2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-465103818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e14a09-b16f-45b9-aa31-0978d1c199a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:37Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c497318-7cc6-40c6-a32d-2ad74a0e29f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c497318-7cc6-40c6-a32d-2ad74a0e29f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505f31c9-aff0-436c-ad7c-0e0b62b70d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505f31c9-aff0-436c-ad7c-0e0b62b70d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e14a09-b16f-45b9-aa31-0978d1c199a5', 'volume_name': 'volume-81e14a09-b16f-45b9-aa31-0978d1c199a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0653b7-edf4-4373-b2d3-713d8015c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0653b7-edf4-4373-b2d3-713d8015c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be11c3fc-d84f-4a26-b5b5-284f1e4f8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Volume 81e14a09-b16f-45b9-aa31-0978d1c199a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e14a09-b16f-45b9-aa31-0978d1c199a5', 'volume_size': 1} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-465103818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e14a09-b16f-45b9-aa31-0978d1c199a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:37Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Creating volume 81e14a09-b16f-45b9-aa31-0978d1c199a5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:37 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 1073741824 Sep 02 12:55:37 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:37 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:37 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:37 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:37 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c Sep 02 12:55:37 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:37 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:55:37 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c743e113-d8ce-40df-a168-14e793c8cf6c" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "cinder-quobyte-c743e113-d8ce-40df-a168-14e793c8cf6c" released by "delete_volume" :: held 0.962s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:37 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 1073741824" returned: 0 in 0.703s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Created reservations ['a10aef8a-9aa2-4627-9dfa-a484705998be', 'ad1cea8b-5dca-4666-a37c-87d4cc5a0095', 'dc812aae-6dee-4ab6-9ffc-484462c15a20', 'fa902e3a-79d6-4b3e-9a96-a9ccfd03111f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:38 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 Sep 02 12:55:38 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:38 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:38 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:38 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be11c3fc-d84f-4a26-b5b5-284f1e4f8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e14a09-b16f-45b9-aa31-0978d1c199a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47114ef7-97a3-4ac7-9c01-a5fc53c71313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Volume volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 (81e14a09-b16f-45b9-aa31-0978d1c199a5): created successfully Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47114ef7-97a3-4ac7-9c01-a5fc53c71313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (44a3ae19-82f8-4fc2-98c8-f718a1725f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7dbd0b53-e560-4b8a-b3aa-888250cfa554 tempest-VolumesListTestJSON-2142993942 None] Created volume successfully. Sep 02 12:55:38 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Deleted volume successfully. Sep 02 12:55:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932ac1a1-b75f-40b5-a7d1-6432d86dbfb3 tempest-VolumesMetadataTest-1574841997 None] Lock "cinder-c743e113-d8ce-40df-a168-14e793c8cf6c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (f74b5c38-8c73-4a8c-9cf6-8938aef30eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b042c604-206a-49b4-a17a-ea56e70fcb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b042c604-206a-49b4-a17a-ea56e70fcb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1236747214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:40Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f60cb-db3f-433f-ab6f-d9caa08ab41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f60cb-db3f-433f-ab6f-d9caa08ab41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce22397-5018-4be3-abe2-3d409c2e73dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce22397-5018-4be3-abe2-3d409c2e73dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3', 'volume_name': 'volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a8c32-cd8e-4cf3-84e3-6068179140d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9a8c32-cd8e-4cf3-84e3-6068179140d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174ead7-8943-490f-a4da-ce2504f5b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Volume a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3', 'volume_size': 1} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1236747214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:40Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Creating volume a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:40 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:40 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 1073741824 Sep 02 12:55:40 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:40 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 1073741824" returned: 0 in 0.544s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:40 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 Sep 02 12:55:40 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:41 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9174ead7-8943-490f-a4da-ce2504f5b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa86f272-b047-4df2-bf98-6f247b8834eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Volume volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 (a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3): created successfully Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa86f272-b047-4df2-bf98-6f247b8834eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (f74b5c38-8c73-4a8c-9cf6-8938aef30eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6c2109a5-0978-4a93-941f-b0f63bbe108f tempest-VolumesListTestJSON-2142993942 None] Created volume successfully. Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (623b44db-e28c-4721-9272-71a1044bfb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98f4da0-a176-43e4-a018-7919011b105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98f4da0-a176-43e4-a018-7919011b105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1633541588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca16bacc-6d66-40b3-b49b-1ef8206944ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:43Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b797aa87-e514-45bd-a947-7e3cec3b0946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b797aa87-e514-45bd-a947-7e3cec3b0946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88293a3-b762-42dc-8240-5d7d67adda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88293a3-b762-42dc-8240-5d7d67adda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca16bacc-6d66-40b3-b49b-1ef8206944ba', 'volume_name': 'volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea22d6d-23cc-42f1-84c5-35ab071880fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea22d6d-23cc-42f1-84c5-35ab071880fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262bd3af-bd1d-4282-86f6-1d3e7b6e9c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Volume ca16bacc-6d66-40b3-b49b-1ef8206944ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba', 'volume_size': 1} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1633541588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca16bacc-6d66-40b3-b49b-1ef8206944ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fecbd8780e064da88dbbc836fae63090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:43Z,use_quota=True,user_id='c5e912e40d2a4e6f93446b328a280768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Creating volume ca16bacc-6d66-40b3-b49b-1ef8206944ba {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:42 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba 1073741824 Sep 02 12:55:42 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:43 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba 1073741824" returned: 0 in 0.461s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:43 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba Sep 02 12:55:43 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:43 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262bd3af-bd1d-4282-86f6-1d3e7b6e9c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52b1d1-7046-43b0-9f1d-3be3840dd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Volume volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba (ca16bacc-6d66-40b3-b49b-1ef8206944ba): created successfully Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d52b1d1-7046-43b0-9f1d-3be3840dd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Flow 'volume_create_manager' (623b44db-e28c-4721-9272-71a1044bfb68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4a791f10-4814-4d0f-8261-5efce0fb0ec0 tempest-VolumesListTestJSON-2142993942 None] Created volume successfully. Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Flow 'volume_create_manager' (32e19e52-5519-4e5d-aa33-15f3b4dab8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922dd57-6633-4f3a-9ec5-72ec9610ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922dd57-6633-4f3a-9ec5-72ec9610ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1784197489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb32d02-58fd-4ca8-875e-7e636a87f2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6850ca8cc4934c3485928b9e175aaf2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:44Z,use_quota=True,user_id='4c4806f5c873421cac0fd9bcb41109db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52bb504-17d1-437e-9166-febd74e378cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52bb504-17d1-437e-9166-febd74e378cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3427855-d5a6-40f5-8503-c00ad0804947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3427855-d5a6-40f5-8503-c00ad0804947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb32d02-58fd-4ca8-875e-7e636a87f2f4', 'volume_name': 'volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99208fa6-38c8-4892-850b-b9106aaeed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99208fa6-38c8-4892-850b-b9106aaeed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ccbf18-e744-4bf2-b93b-509f588c846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Volume deb32d02-58fd-4ca8-875e-7e636a87f2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4', 'volume_size': 1} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1784197489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb32d02-58fd-4ca8-875e-7e636a87f2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6850ca8cc4934c3485928b9e175aaf2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:44Z,use_quota=True,user_id='4c4806f5c873421cac0fd9bcb41109db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Creating volume deb32d02-58fd-4ca8-875e-7e636a87f2f4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:44 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 1073741824 Sep 02 12:55:44 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:44 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 1073741824" returned: 0 in 0.453s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:44 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 Sep 02 12:55:44 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:45 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ccbf18-e744-4bf2-b93b-509f588c846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce35a1cc-cb23-4142-a8b2-79a4d36efc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Volume volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 (deb32d02-58fd-4ca8-875e-7e636a87f2f4): created successfully Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce35a1cc-cb23-4142-a8b2-79a4d36efc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Flow 'volume_create_manager' (32e19e52-5519-4e5d-aa33-15f3b4dab8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aeb06b10-4986-4222-974e-f2c5b64ae716 tempest-VolumesTransfersV355Test-1325105016 None] Created volume successfully. Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-ca16bacc-6d66-40b3-b49b-1ef8206944ba-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-ca16bacc-6d66-40b3-b49b-1ef8206944ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-quobyte-ca16bacc-6d66-40b3-b49b-1ef8206944ba" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-ca16bacc-6d66-40b3-b49b-1ef8206944ba" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca48c0-d644-4553-a796-05bb13bd4b2c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-df0ad79d-312e-4a90-8bf8-14b29e43d80b tempest-VolumesTransfersV355Test-354495477 None] Transfer volume completed successfully. Sep 02 12:55:45 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba Sep 02 12:55:45 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:46 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:46 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba Sep 02 12:55:46 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "cinder-deb32d02-58fd-4ca8-875e-7e636a87f2f4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-deb32d02-58fd-4ca8-875e-7e636a87f2f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "cinder-quobyte-deb32d02-58fd-4ca8-875e-7e636a87f2f4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-quobyte-deb32d02-58fd-4ca8-875e-7e636a87f2f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55acd7-3779-4508-9e88-08be071c8bf3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:46 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ca16bacc-6d66-40b3-b49b-1ef8206944ba" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-ca16bacc-6d66-40b3-b49b-1ef8206944ba" released by "delete_volume" :: held 0.687s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:46 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 Sep 02 12:55:46 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Created reservations ['a1cc4496-dfe4-48b0-9492-acdbd4d51d6b', '3eb4f124-4284-4752-a1f7-0399050a9a2e', '5f681197-3a3c-4831-a171-9db6ab5d95b3', 'f87c3874-b2a7-480c-a3eb-a9fa5565beb3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:46 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:46 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:46 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:46 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4 Sep 02 12:55:46 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:46 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Deleted volume successfully. Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef6253df-db18-44f9-9703-249ef9621e05 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-ca16bacc-6d66-40b3-b49b-1ef8206944ba-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-quobyte-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c166a9-9c7e-486c-85eb-ed5a094ef9b8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:47 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-deb32d02-58fd-4ca8-875e-7e636a87f2f4" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-quobyte-deb32d02-58fd-4ca8-875e-7e636a87f2f4" released by "delete_volume" :: held 0.801s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Created reservations ['ec553b5d-074b-460a-9522-ddcbf68114d3', '24fde5de-d509-41d4-8c53-f393c9052d37', 'e678a036-7d4a-40c5-9937-4e1cd2e484da', 'eac8e0b6-75e8-4eec-a857-bba0467f9b31'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:47 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 Sep 02 12:55:47 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:47 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:47 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:47 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:47 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3 Sep 02 12:55:47 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:47 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Deleted volume successfully. Sep 02 12:55:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-75d6bfb6-5f58-454b-9dad-5cd6d7804fd3 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-deb32d02-58fd-4ca8-875e-7e636a87f2f4-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:48 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" returned: 0 in 0.446s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3" released by "delete_volume" :: held 1.004s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Created reservations ['7878341a-462f-4997-8237-9e69b93760d0', 'e47ad7fd-847f-4122-9ee4-0cb53af6c60f', 'd21914bd-0745-4335-9338-4cd6c03a247c', '5f730405-0e04-4b03-b66b-43b176acdd84'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:48 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:48 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Flow 'volume_create_manager' (cc6ac36c-f963-4c15-bf43-14fbf12872e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d0835b-4257-48fc-9cd2-a84897731742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d0835b-4257-48fc-9cd2-a84897731742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-565112036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4788cfde-22d7-4036-81ad-6b660b82cfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6850ca8cc4934c3485928b9e175aaf2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:48Z,use_quota=True,user_id='4c4806f5c873421cac0fd9bcb41109db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37394eea-a50c-46cf-a718-df6e4ac1001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37394eea-a50c-46cf-a718-df6e4ac1001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b230c8-c2b2-486b-9e59-fd40da7d28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b230c8-c2b2-486b-9e59-fd40da7d28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4788cfde-22d7-4036-81ad-6b660b82cfba', 'volume_name': 'volume-4788cfde-22d7-4036-81ad-6b660b82cfba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9140e8b-5618-4978-b581-e4535a712f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9140e8b-5618-4978-b581-e4535a712f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca530b79-fe2f-4da7-8a41-2d31fa8351b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Volume 4788cfde-22d7-4036-81ad-6b660b82cfba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4788cfde-22d7-4036-81ad-6b660b82cfba', 'volume_size': 1} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-565112036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4788cfde-22d7-4036-81ad-6b660b82cfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6850ca8cc4934c3485928b9e175aaf2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:48Z,use_quota=True,user_id='4c4806f5c873421cac0fd9bcb41109db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Creating volume 4788cfde-22d7-4036-81ad-6b660b82cfba {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:48 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:48 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba 1073741824 Sep 02 12:55:48 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:48 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Deleted volume successfully. Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9904961a-d589-41c7-9687-35f88ddfbeba tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-a5c19477-2c0d-4a55-a0b3-8a15dc9fe0d3-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:48 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba 1073741824" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:48 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba Sep 02 12:55:48 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:49 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca530b79-fe2f-4da7-8a41-2d31fa8351b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4788cfde-22d7-4036-81ad-6b660b82cfba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21452f47-3c5d-42fd-8d49-cab82f5461d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Volume volume-4788cfde-22d7-4036-81ad-6b660b82cfba (4788cfde-22d7-4036-81ad-6b660b82cfba): created successfully Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21452f47-3c5d-42fd-8d49-cab82f5461d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Flow 'volume_create_manager' (cc6ac36c-f963-4c15-bf43-14fbf12872e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f057864d-3299-4169-a782-d8ab73412f8c tempest-VolumesTransfersV355Test-1325105016 None] Created volume successfully. Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-81e14a09-b16f-45b9-aa31-0978d1c199a5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-81e14a09-b16f-45b9-aa31-0978d1c199a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "cinder-quobyte-81e14a09-b16f-45b9-aa31-0978d1c199a5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-81e14a09-b16f-45b9-aa31-0978d1c199a5" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf09e41-a17d-412d-942b-8542d0a4ba8c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:49 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 Sep 02 12:55:49 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:49 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:49 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5 Sep 02 12:55:49 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:50 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-81e14a09-b16f-45b9-aa31-0978d1c199a5" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-quobyte-81e14a09-b16f-45b9-aa31-0978d1c199a5" released by "delete_volume" :: held 0.740s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Created reservations ['26ab754b-f57a-45f7-aaac-9faa39203965', '7de20c3f-a5fe-4e0e-813e-8a692d778193', 'f4a776cb-e613-4403-a7e4-969a9b6088e2', 'a5eff286-f8a9-48c9-9b7c-6b8d9385161f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:50 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:50 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:50 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Deleted volume successfully. Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82b5888e-dc29-43ab-bb22-3c7dcc3eb4f7 tempest-VolumesListTestJSON-2142993942 None] Lock "cinder-81e14a09-b16f-45b9-aa31-0978d1c199a5-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "cinder-4788cfde-22d7-4036-81ad-6b660b82cfba-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-4788cfde-22d7-4036-81ad-6b660b82cfba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "cinder-quobyte-4788cfde-22d7-4036-81ad-6b660b82cfba" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-quobyte-4788cfde-22d7-4036-81ad-6b660b82cfba" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb2781-7c4e-4d36-86d1-5e9274f32f23]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:55:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:50 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba Sep 02 12:55:50 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:51 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:51 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba Sep 02 12:55:51 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:51 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4788cfde-22d7-4036-81ad-6b660b82cfba" returned: 0 in 0.293s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-quobyte-4788cfde-22d7-4036-81ad-6b660b82cfba" released by "delete_volume" :: held 0.756s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Created reservations ['159be1f5-11a6-43ba-89a3-bc6a6e85f123', '4d0c2492-534d-4643-9706-1ec7880d8d3e', '2547826c-f172-48fd-9f15-33efc3b13848', '1e04bb20-3484-413e-87fd-6fcc7ac96fc5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:51 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:55:51 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:52 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:55:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Deleted volume successfully. Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-abd3d906-2f36-44db-a962-a3984a109330 tempest-VolumesTransfersV355Test-2109146484 None] Lock "cinder-4788cfde-22d7-4036-81ad-6b660b82cfba-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1878f251-8475-470a-a554-53c45814bcc5 req-ecef3c1b-f97f-4b70-b073-f32d255146d9 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1878f251-8475-470a-a554-53c45814bcc5 req-ecef3c1b-f97f-4b70-b073-f32d255146d9 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1878f251-8475-470a-a554-53c45814bcc5 req-ecef3c1b-f97f-4b70-b073-f32d255146d9 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-1878f251-8475-470a-a554-53c45814bcc5 req-ecef3c1b-f97f-4b70-b073-f32d255146d9 tempest-TestInstancesWithCinderVolumes-1969036388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-4dd2f490-af5e-4cae-becf-2be547757f11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ff81a77-8fea-4356-bf90-3a84374f7a91', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:55:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1878f251-8475-470a-a554-53c45814bcc5 req-ecef3c1b-f97f-4b70-b073-f32d255146d9 tempest-TestInstancesWithCinderVolumes-1969036388 None] attachment_update completed successfully. Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=103,cinder:UPDATE=140,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=134,cinder:INSERT=32,cinder:DELETE=13,cinder:SELECT=102 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Flow 'volume_create_manager' (7eec968c-14cb-472e-b2e1-089eafde36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b61a52f-d8a2-46c1-93fc-36a5955b0482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b61a52f-d8a2-46c1-93fc-36a5955b0482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-496304730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae0178-82ac-4e83-98b0-12765683195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b664d3e2c4814335871390bd05de32a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:54Z,use_quota=True,user_id='23c875bd5fd9482a8146e5ab3c57cd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2012732-dd05-4fd3-ad0d-143c603e4e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2012732-dd05-4fd3-ad0d-143c603e4e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c447615e-6fa2-44ca-9c91-6edd65d3de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c447615e-6fa2-44ca-9c91-6edd65d3de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ae0178-82ac-4e83-98b0-12765683195e', 'volume_name': 'volume-b3ae0178-82ac-4e83-98b0-12765683195e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f9e7ca-e6e8-4539-b829-c5421e505371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f9e7ca-e6e8-4539-b829-c5421e505371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dd6916-763e-4a39-93a3-0f2a17510a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Volume b3ae0178-82ac-4e83-98b0-12765683195e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ae0178-82ac-4e83-98b0-12765683195e', 'volume_size': 1} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-496304730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae0178-82ac-4e83-98b0-12765683195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b664d3e2c4814335871390bd05de32a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:55:54Z,use_quota=True,user_id='23c875bd5fd9482a8146e5ab3c57cd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Creating volume b3ae0178-82ac-4e83-98b0-12765683195e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:55:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:54 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e 1073741824 Sep 02 12:55:54 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-001e516b-e278-404e-86b0-04d471c0afb7 req-ebea0ba9-00f7-49bd-8c1c-9f82699042ff tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:55:55 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e 1073741824" returned: 0 in 0.543s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:55:55 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e Sep 02 12:55:55 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:55:55 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-001e516b-e278-404e-86b0-04d471c0afb7 req-ebea0ba9-00f7-49bd-8c1c-9f82699042ff tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.672s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dd6916-763e-4a39-93a3-0f2a17510a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ae0178-82ac-4e83-98b0-12765683195e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a870421b-4176-4fc6-af7b-3fa7e64416f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-001e516b-e278-404e-86b0-04d471c0afb7 req-ebea0ba9-00f7-49bd-8c1c-9f82699042ff tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:55:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Volume volume-b3ae0178-82ac-4e83-98b0-12765683195e (b3ae0178-82ac-4e83-98b0-12765683195e): created successfully Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a870421b-4176-4fc6-af7b-3fa7e64416f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Flow 'volume_create_manager' (7eec968c-14cb-472e-b2e1-089eafde36c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:55:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-29dc3ee4-40b9-41f3-b309-5dcf04c60d5d tempest-VolumesNegativeTest-458982856 None] Created volume successfully. Sep 02 12:55:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-001e516b-e278-404e-86b0-04d471c0afb7 req-ebea0ba9-00f7-49bd-8c1c-9f82699042ff tempest-TestInstancesWithCinderVolumes-1969036388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63d8a0cf-dc03-4394-8d1d-4af0e4b70b9f', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:55:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-001e516b-e278-404e-86b0-04d471c0afb7 req-ebea0ba9-00f7-49bd-8c1c-9f82699042ff tempest-TestInstancesWithCinderVolumes-1969036388 None] attachment_update completed successfully. Sep 02 12:56:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a79964a3-1b89-42c5-8bd1-09f8fd14abc9 req-5ed8974f-46dd-402e-a024-008d598d8410 tempest-TestInstancesWithCinderVolumes-1969036388 None] Terminate volume connection completed successfully. Sep 02 12:56:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a79964a3-1b89-42c5-8bd1-09f8fd14abc9 req-5ed8974f-46dd-402e-a024-008d598d8410 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleting attachment 6ff81a77-8fea-4356-bf90-3a84374f7a91. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-4dd2f490-af5e-4cae-becf-2be547757f11-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-4dd2f490-af5e-4cae-becf-2be547757f11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-quobyte-4dd2f490-af5e-4cae-becf-2be547757f11" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-4dd2f490-af5e-4cae-becf-2be547757f11" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436107d-5a51-4d02-81f9-5f0d3f68589d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:03 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 Sep 02 12:56:03 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:04 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11" returned: 0 in 0.615s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:04 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11 Sep 02 12:56:04 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:04 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4dd2f490-af5e-4cae-becf-2be547757f11" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-4dd2f490-af5e-4cae-becf-2be547757f11" released by "delete_volume" :: held 1.071s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:04 devstack cinder-volume[87092]: WARNING cinder.quota [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566279786-537220367 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566279786-537220367, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:04 devstack cinder-volume[87092]: WARNING cinder.quota [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566279786-537220367 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1566279786-537220367, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Created reservations ['33856e61-f5ba-4951-af80-c3659282f18c', 'da0a9eda-a046-4e04-8db0-a0d2001eec1c', '98dc68f2-f950-42b6-bced-d8da9b31f8f4', '4d47b062-89c0-4d45-adc4-bbfe49e6e16b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:04 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:04 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:05 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:05 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleted volume successfully. Sep 02 12:56:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e9b62f96-6546-4a52-9196-87e6eb74eae1 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-4dd2f490-af5e-4cae-becf-2be547757f11-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Flow 'volume_create_manager' (0944418c-89c7-4794-b775-be8c92721767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411558e-da72-4013-bb25-29ce6b407f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411558e-da72-4013-bb25-29ce6b407f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1537651609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f48b210-d22a-4de5-9c28-2b3b1cae42ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529eb9ac21f14729b28b81c0a3817075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:56:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:56:06Z,use_quota=True,user_id='093a4707ee8b492f8aa375419f3444af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898617a4-3b04-4330-b37a-c9bdce39a8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898617a4-3b04-4330-b37a-c9bdce39a8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caf6dd1-09bd-4a92-9f2b-493de6bcc0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caf6dd1-09bd-4a92-9f2b-493de6bcc0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f48b210-d22a-4de5-9c28-2b3b1cae42ca', 'volume_name': 'volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d3af0c-d0d6-46bf-b8b2-b27c03dbdf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d3af0c-d0d6-46bf-b8b2-b27c03dbdf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3b8ea9-4254-4373-9efc-1966734a51ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Volume 0f48b210-d22a-4de5-9c28-2b3b1cae42ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca', 'volume_size': 2} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1537651609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f48b210-d22a-4de5-9c28-2b3b1cae42ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529eb9ac21f14729b28b81c0a3817075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:56:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:56:06Z,use_quota=True,user_id='093a4707ee8b492f8aa375419f3444af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Creating volume 0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:56:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca 2147483648 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:06 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca 2147483648 Sep 02 12:56:06 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:06 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca 2147483648" returned: 0 in 0.587s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:06 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca Sep 02 12:56:06 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:07 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3b8ea9-4254-4373-9efc-1966734a51ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6de529-13cb-4549-8ef5-559c5ea68c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Volume volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca (0f48b210-d22a-4de5-9c28-2b3b1cae42ca): created successfully Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6de529-13cb-4549-8ef5-559c5ea68c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Flow 'volume_create_manager' (0944418c-89c7-4794-b775-be8c92721767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:56:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0e6d8858-2cff-4535-aa5a-4e613c1103a7 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Created volume successfully. Sep 02 12:56:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-356a9881-5ec8-431b-8459-771334cf6df7 req-f612c6c6-8b8e-49eb-9654-62e4a280ff97 tempest-TestInstancesWithCinderVolumes-1969036388 None] Terminate volume connection completed successfully. Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-356a9881-5ec8-431b-8459-771334cf6df7 req-f612c6c6-8b8e-49eb-9654-62e4a280ff97 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleting attachment 63d8a0cf-dc03-4394-8d1d-4af0e4b70b9f. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Creating offline snapshot 4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 of volume 0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-9b7b3189-5387-47d0-81d6-7f31a0d84df7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f916cc-9944-41b7-8088-9c299f54b7b3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-9b7b3189-5387-47d0-81d6-7f31a0d84df7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-quobyte-9b7b3189-5387-47d0-81d6-7f31a0d84df7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-9b7b3189-5387-47d0-81d6-7f31a0d84df7" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[007c7832-9e3d-4c45-8476-0be3faf6a509]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:09 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca Sep 02 12:56:09 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:09 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 Sep 02 12:56:09 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:09 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" returned: 0 in 0.597s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:09 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 2G Sep 02 12:56:09 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:09 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7" returned: 0 in 0.520s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:09 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7 Sep 02 12:56:09 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:09 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9b7b3189-5387-47d0-81d6-7f31a0d84df7" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-9b7b3189-5387-47d0-81d6-7f31a0d84df7" released by "delete_volume" :: held 1.021s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:10 devstack cinder-volume[87092]: WARNING cinder.quota [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1747807308-1595684207 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1747807308-1595684207, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:10 devstack cinder-volume[87092]: WARNING cinder.quota [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1747807308-1595684207 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1747807308-1595684207, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Created reservations ['14eb47fb-2b06-47ff-9401-83c7f36742c4', '7542b214-4f6f-4c81-8fc7-8a5708b24863', '374f6af3-3c5a-4f30-99ca-4b8b408398a1', 'c39142bc-d04a-4fca-9382-abed93713964'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:10 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 2G" returned: 0 in 0.758s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:10 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:10 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:10 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 Sep 02 12:56:10 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:10 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleted volume successfully. Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-27367a12-2844-417c-add4-10431feabda5 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-9b7b3189-5387-47d0-81d6-7f31a0d84df7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:10 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:10 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 is being set with open permissions: ugo+rw Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:10 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 Sep 02 12:56:10 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:10 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:11 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info Sep 02 12:56:11 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:11 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info is being set with open permissions: ugo+rw Sep 02 12:56:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:11 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info Sep 02 12:56:11 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:11 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.info" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cda537b9-c09f-42a6-b744-222d374399f4 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Create snapshot completed successfully Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "cinder-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "cinder-quobyte-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Deleting offline snapshot 4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 of volume 0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] snapshot_file for this snap is: volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f7d4bd-42ef-4fa7-8a4f-84a05f3e8e09]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:12 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 Sep 02 12:56:12 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:13 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" returned: 0 in 0.793s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b865bd-df76-4a64-b057-cc979bd58252]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:13 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca Sep 02 12:56:13 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:13 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:13 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 Sep 02 12:56:13 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-10418179-9999-4999-9a7f-151a8c8c52bb req-7b887058-43a4-46b1-a111-be5f23aa06b0 tempest-TestInstancesWithCinderVolumes-1969036388 None] Terminate volume connection completed successfully. Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-10418179-9999-4999-9a7f-151a8c8c52bb req-7b887058-43a4-46b1-a111-be5f23aa06b0 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleting attachment 39d742c7-3256-4820-a657-f27e643d9bfe. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:56:14 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" returned: 0 in 0.642s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:14 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90 Sep 02 12:56:14 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:14 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca.4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90" released by "_delete_snapshot" :: held 2.371s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" released by "delete_snapshot" :: held 2.406s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Created reservations ['4d4fdb2a-b726-4c06-ba15-d94022e09b79', '7367366e-62a9-4beb-a2b1-a2616e4f9090', 'b580c31f-744d-4c74-9cfa-087e81d0bb64', '3921641a-4aaa-498d-8140-1c0159e5c865'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Delete snapshot completed successfully. Sep 02 12:56:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-37d51efc-3e0b-4dbf-b116-e08cb6247a59 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-4d3c3ecd-19d2-4948-80f9-367fdcbbdf90-delete_snapshot" released by "delete_snapshot" :: held 2.685s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-ec1edc14-d54a-420a-865d-53984cd9a486-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-ec1edc14-d54a-420a-865d-53984cd9a486-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "cinder-quobyte-ec1edc14-d54a-420a-865d-53984cd9a486" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-ec1edc14-d54a-420a-865d-53984cd9a486" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93053fd-e8c3-40d5-8539-f4ffb7bc9c86]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "cinder-0f48b210-d22a-4de5-9c28-2b3b1cae42ca-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:15 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 Sep 02 12:56:15 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-0f48b210-d22a-4de5-9c28-2b3b1cae42ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b452dd-871b-4248-92b3-6f00dacd5054]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:15 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca Sep 02 12:56:15 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:15 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:15 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486 Sep 02 12:56:15 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:16 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:16 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ec1edc14-d54a-420a-865d-53984cd9a486" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:16 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca Sep 02 12:56:16 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-quobyte-ec1edc14-d54a-420a-865d-53984cd9a486" released by "delete_volume" :: held 0.739s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:16 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1922393628-732263446 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1922393628-732263446, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:16 devstack cinder-volume[87092]: WARNING cinder.quota [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1922393628-732263446 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1922393628-732263446, it is now deprecated. Please use the default quota class for default quota. Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Created reservations ['5acfd663-78f8-4a79-b1a7-6dd5a29f125c', 'f8f030fd-0310-44a5-a9ab-e96bfdc6a8bc', '2b20e656-caa8-4e08-be74-1c2b62e478fc', '2ce23553-971a-4ac4-b60b-cb859e347ce4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:16 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:16 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:16 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-quobyte-0f48b210-d22a-4de5-9c28-2b3b1cae42ca" released by "delete_volume" :: held 0.736s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Created reservations ['436263a5-dd49-4133-a165-0c7c40e364fc', '529b9069-ca6e-4f99-abc2-81bf7ebccb61', 'a3e2e763-8106-44ff-94c3-0ee774426224', '332f3f6b-fbe6-47bf-b84a-d239fd37ad61'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:16 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:16 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:16 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Deleted volume successfully. Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5cd2b55-ffda-4512-9dce-50af8c3cc8d2 tempest-TestInstancesWithCinderVolumes-1969036388 None] Lock "cinder-ec1edc14-d54a-420a-865d-53984cd9a486-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:16 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Deleted volume successfully. Sep 02 12:56:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67d8a8f0-272a-41c4-ad49-1e36acc80be1 tempest-VolumesSnapshotNegativeTestJSON-112494979 None] Lock "cinder-0f48b210-d22a-4de5-9c28-2b3b1cae42ca-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Acquiring lock "cinder-b3ae0178-82ac-4e83-98b0-12765683195e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "cinder-b3ae0178-82ac-4e83-98b0-12765683195e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Acquiring lock "cinder-quobyte-b3ae0178-82ac-4e83-98b0-12765683195e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "cinder-quobyte-b3ae0178-82ac-4e83-98b0-12765683195e" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c57021-9c47-40c1-a6f2-04ec04404534]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:23 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e Sep 02 12:56:23 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:23 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:23 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e Sep 02 12:56:23 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:23 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3ae0178-82ac-4e83-98b0-12765683195e" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "cinder-quobyte-b3ae0178-82ac-4e83-98b0-12765683195e" released by "delete_volume" :: held 0.769s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Created reservations ['9ff55060-cd3b-43f1-8da3-f48a275aeb9d', 'a27cc33b-6b12-4fef-b7d1-30a1ce3c4298', '8c44da44-d36e-48da-9baa-a2ffecd5119e', 'e0d48b35-1ef3-425b-9af8-df0369ddd366'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:24 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:24 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:24 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Deleted volume successfully. Sep 02 12:56:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-880d4409-38e4-4894-8677-0ae86e20df99 tempest-VolumesNegativeTest-458982856 None] Lock "cinder-b3ae0178-82ac-4e83-98b0-12765683195e-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:33 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:56:34 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=52,cinder:UPDATE=50,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:37 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:56:37 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:37 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:56:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (80f01929-1a05-4c94-bcc3-5819dc3716e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bec581-43bf-4ff5-9d14-0b0d566e6ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bec581-43bf-4ff5-9d14-0b0d566e6ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-149508039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac67213-b467-49f8-a80d-c0c1bc6127ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:56:51Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d53796-8509-413e-9e3d-87a928099bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d53796-8509-413e-9e3d-87a928099bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18348a0-95d5-4cc7-a7fc-57885d817629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18348a0-95d5-4cc7-a7fc-57885d817629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac67213-b467-49f8-a80d-c0c1bc6127ce', 'volume_name': 'volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf88a64-d3df-45fb-970d-f90f375bf751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf88a64-d3df-45fb-970d-f90f375bf751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a47905-3d89-4631-8dab-1133ad9a24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume 5ac67213-b467-49f8-a80d-c0c1bc6127ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce', 'volume_size': 1} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-149508039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac67213-b467-49f8-a80d-c0c1bc6127ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:56:51Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Creating volume 5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:56:51 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:56:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:51 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce 1073741824 Sep 02 12:56:51 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:52 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce 1073741824" returned: 0 in 0.696s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:52 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce Sep 02 12:56:52 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:52 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a47905-3d89-4631-8dab-1133ad9a24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ac8497-d275-41da-a930-0c7e36c393ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:56:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce (5ac67213-b467-49f8-a80d-c0c1bc6127ce): created successfully Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ac8497-d275-41da-a930-0c7e36c393ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:56:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (80f01929-1a05-4c94-bcc3-5819dc3716e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:56:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1cf95c61-a6d0-4877-8293-45f3b40a95c5 tempest-VolumesSnapshotTestJSON-1274883758 None] Created volume successfully. Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Creating offline snapshot c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 of volume 5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d1788f-bd9c-4a47-887c-00934a7ef189]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:54 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce Sep 02 12:56:54 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:54 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce" returned: 0 in 0.544s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:54 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 1G Sep 02 12:56:54 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:55 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 1G" returned: 0 in 0.548s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:55 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 Sep 02 12:56:55 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:55 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:55 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 is being set with open permissions: ugo+rw Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:55 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 Sep 02 12:56:55 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:55 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" returned: 0 in 0.312s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:56 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info Sep 02 12:56:56 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:56 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:56 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info is being set with open permissions: ugo+rw Sep 02 12:56:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:56 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info Sep 02 12:56:56 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:56 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.info" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:56:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9ea9a1d5-5be7-42b8-a621-349a5245b30a tempest-VolumesSnapshotTestJSON-1274883758 None] Create snapshot completed successfully Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Deleting offline snapshot c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 of volume 5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] snapshot_file for this snap is: volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2584028a-1c5b-49f6-bc79-be2b0817bc0d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:57 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 Sep 02 12:56:57 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:58 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" returned: 0 in 0.479s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c29d8d-ceae-40e6-9aaa-3ae6c3dc037f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:58 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce Sep 02 12:56:58 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:58 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:58 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 Sep 02 12:56:58 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:59 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" returned: 0 in 0.586s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:56:59 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0 Sep 02 12:56:59 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:56:59 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce.c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0" released by "_delete_snapshot" :: held 2.103s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" released by "delete_snapshot" :: held 2.142s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:56:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['9bd30d25-3555-4602-8765-64a3116ee529', 'eb8ed866-db94-45bf-8c88-bba321b13bdc', 'e291f948-99ce-4363-8419-c5a5931965dc', '1abcee7a-7956-4fa3-8ea3-3e222a953f9d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Delete snapshot completed successfully. Sep 02 12:57:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e6613a2d-4815-4318-9f77-ac8a27ab11cb tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-c6f91ea9-003e-4ab5-ba86-e0daae1bc0e0-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (5f088261-6b79-4489-957b-dac4a31e2637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829b005b-ade1-4b5f-8d13-5b5af7199002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829b005b-ade1-4b5f-8d13-5b5af7199002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1129581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca5e74-6043-4536-a8fb-7e319e71b4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:02Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0653122-aa9f-4198-822f-9edb03a5732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0653122-aa9f-4198-822f-9edb03a5732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff495b-85f9-4f48-a1dd-6b47d6f851af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff495b-85f9-4f48-a1dd-6b47d6f851af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ca5e74-6043-4536-a8fb-7e319e71b4ad', 'volume_name': 'volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cf404f-6a34-4475-ac5c-e5cb5c88879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cf404f-6a34-4475-ac5c-e5cb5c88879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c893f1-8223-4e6c-a004-774c77b1b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume 60ca5e74-6043-4536-a8fb-7e319e71b4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad', 'volume_size': 1} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1129581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca5e74-6043-4536-a8fb-7e319e71b4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:02Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Creating volume 60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:01 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad 1073741824 Sep 02 12:57:01 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:02 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad 1073741824" returned: 0 in 0.739s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:02 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:02 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:03 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c893f1-8223-4e6c-a004-774c77b1b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2c5d8-70b3-481a-88d5-cee58599465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad (60ca5e74-6043-4536-a8fb-7e319e71b4ad): created successfully Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2c5d8-70b3-481a-88d5-cee58599465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (5f088261-6b79-4489-957b-dac4a31e2637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d6f67de-d343-4083-9b2e-2a7723011957 tempest-VolumesSnapshotTestJSON-1274883758 None] Created volume successfully. Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Creating offline snapshot cbe94a35-6106-485f-a119-045b4f3616ee of volume 60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b89eb-702c-4f60-8f2a-d4e623c99ed0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:04 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:04 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Flow 'volume_create_manager' (30ec66e8-ec6b-45fa-bd9d-20b5bc9742e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce6c772-6265-44ae-8e8b-bc5b1fe74e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce6c772-6265-44ae-8e8b-bc5b1fe74e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1761665099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbab7ae-23bf-4e43-b927-9e859f916584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed826f70ce419190bcf23961053342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:04Z,use_quota=True,user_id='b7ff7b07688c460684e3cdcc409cd2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95217f7c-e1ea-4225-9a2a-8fb32424fc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95217f7c-e1ea-4225-9a2a-8fb32424fc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e33831-b0e2-4a4b-bf79-ee284c208046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e33831-b0e2-4a4b-bf79-ee284c208046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbab7ae-23bf-4e43-b927-9e859f916584', 'volume_name': 'volume-5bbab7ae-23bf-4e43-b927-9e859f916584', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69538a27-382d-4fcf-99b1-46c39276e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69538a27-382d-4fcf-99b1-46c39276e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744d629c-2082-42e5-a31c-a13db91612ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Volume 5bbab7ae-23bf-4e43-b927-9e859f916584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbab7ae-23bf-4e43-b927-9e859f916584', 'volume_size': 1} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:04 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:04 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee 1G Sep 02 12:57:04 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Flow 'volume_create_manager' (e55d26d8-e927-4cee-a425-8a33d71d845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57bfbf7-8f76-422d-bc9b-35a2d3330255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57bfbf7-8f76-422d-bc9b-35a2d3330255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-957081450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b03c66-6988-4696-b0bb-0ed4ab7db00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b8e8d1a174c28bef0ca7b47c1a73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:05Z,use_quota=True,user_id='21cf127d865844ac9b792ec1ba221b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2da0c5-5af6-45b1-9cd9-87b99e48f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2da0c5-5af6-45b1-9cd9-87b99e48f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c796123-c554-4f3d-b658-58b8079139ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c796123-c554-4f3d-b658-58b8079139ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b03c66-6988-4696-b0bb-0ed4ab7db00c', 'volume_name': 'volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74257b8-26b7-4ac8-b2d8-a3f8bd140add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74257b8-26b7-4ac8-b2d8-a3f8bd140add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6628a999-cb5e-47d1-ada1-db9cc55e0066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume 08b03c66-6988-4696-b0bb-0ed4ab7db00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c', 'volume_size': 1} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:05 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee 1G" returned: 0 in 0.541s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:05 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:05 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Flow 'volume_create_manager' (c5bd906b-09fe-4491-8896-5c402d790810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57b208b-af47-4205-8a8c-c9f3d80c1db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57b208b-af47-4205-8a8c-c9f3d80c1db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1932465100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b8e8d1a174c28bef0ca7b47c1a73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:05Z,use_quota=True,user_id='21cf127d865844ac9b792ec1ba221b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18d8f7-f3e4-4225-be15-7a561a722049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18d8f7-f3e4-4225-be15-7a561a722049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f22000-1a0d-4b01-a3e2-1f39168062d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f22000-1a0d-4b01-a3e2-1f39168062d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4', 'volume_name': 'volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97529b4-4186-4c32-b5c1-e0fe38346518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97529b4-4186-4c32-b5c1-e0fe38346518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23526ec-8df1-4040-8ea8-5d76d5b0292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume 7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4', 'volume_size': 1} Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:05 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee is being set with open permissions: ugo+rw Sep 02 12:57:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:05 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:05 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:05 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:06 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info Sep 02 12:57:06 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:06 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:06 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info is being set with open permissions: ugo+rw Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:06 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info Sep 02 12:57:06 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:06 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1761665099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbab7ae-23bf-4e43-b927-9e859f916584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed826f70ce419190bcf23961053342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:04Z,use_quota=True,user_id='b7ff7b07688c460684e3cdcc409cd2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Creating volume 5bbab7ae-23bf-4e43-b927-9e859f916584 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:06 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 1073741824 Sep 02 12:57:06 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d661e46a-d8b0-4c5a-be0e-d7ec008feb69 tempest-VolumesSnapshotTestJSON-1274883758 None] Create snapshot completed successfully Sep 02 12:57:07 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 1073741824" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:07 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 Sep 02 12:57:07 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:07 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.301s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-957081450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b03c66-6988-4696-b0bb-0ed4ab7db00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b8e8d1a174c28bef0ca7b47c1a73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:05Z,use_quota=True,user_id='21cf127d865844ac9b792ec1ba221b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Creating volume 08b03c66-6988-4696-b0bb-0ed4ab7db00c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:07 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744d629c-2082-42e5-a31c-a13db91612ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbab7ae-23bf-4e43-b927-9e859f916584', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e9b4c8-4199-4fbb-acaf-247024bd0b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:07 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c 1073741824 Sep 02 12:57:07 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Volume volume-5bbab7ae-23bf-4e43-b927-9e859f916584 (5bbab7ae-23bf-4e43-b927-9e859f916584): created successfully Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e9b4c8-4199-4fbb-acaf-247024bd0b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Flow 'volume_create_manager' (30ec66e8-ec6b-45fa-bd9d-20b5bc9742e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff4374c2-f570-44cd-b7e3-2a7b3d261582 tempest-TestMinimumBasicScenario-1235252650 None] Created volume successfully. Sep 02 12:57:08 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c 1073741824" returned: 0 in 0.738s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (cdd19e56-5c32-4e4e-a34a-4e1446424c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9e929e-e239-4df0-a51a-9c139d069183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9e929e-e239-4df0-a51a-9c139d069183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1103420542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045504a7-9162-426e-8898-79431baf231c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cbe94a35-6106-485f-a119-045b4f3616ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:08Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d545eb2-3a6f-47bc-a3e2-22bd515c5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d545eb2-3a6f-47bc-a3e2-22bd515c5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a011159a-312d-47ec-ba57-0b529b608085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a011159a-312d-47ec-ba57-0b529b608085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '045504a7-9162-426e-8898-79431baf231c', 'volume_name': 'volume-045504a7-9162-426e-8898-79431baf231c', 'volume_size': 2, 'snapshot_id': 'cbe94a35-6106-485f-a119-045b4f3616ee'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206740bd-0ed3-4aa5-b91e-2d800231cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206740bd-0ed3-4aa5-b91e-2d800231cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daff8f75-e226-4824-b10d-e768bdb5d75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Volume 045504a7-9162-426e-8898-79431baf231c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-045504a7-9162-426e-8898-79431baf231c', 'volume_size': 2, 'snapshot_id': 'cbe94a35-6106-485f-a119-045b4f3616ee'} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:08 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c Sep 02 12:57:08 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:08 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1932465100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1b8e8d1a174c28bef0ca7b47c1a73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:05Z,use_quota=True,user_id='21cf127d865844ac9b792ec1ba221b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Creating volume 7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6628a999-cb5e-47d1-ada1-db9cc55e0066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97aba2-9dc8-4080-9ec8-57f0941dcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c (08b03c66-6988-4696-b0bb-0ed4ab7db00c): created successfully Sep 02 12:57:08 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 1073741824 Sep 02 12:57:08 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97aba2-9dc8-4080-9ec8-57f0941dcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Flow 'volume_create_manager' (e55d26d8-e927-4cee-a425-8a33d71d845d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b22b71cb-18fb-4372-88e1-b222654e24d2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Created volume successfully. Sep 02 12:57:09 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 1073741824" returned: 0 in 0.729s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:09 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 Sep 02 12:57:09 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:10 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" returned: 0 in 0.585s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.670s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee-045504a7-9162-426e-8898-79431baf231c" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee-045504a7-9162-426e-8898-79431baf231c" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Creating volume 045504a7-9162-426e-8898-79431baf231c from snapshot cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23526ec-8df1-4040-8ea8-5d76d5b0292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84637e4f-15e9-4102-a845-456f3129a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] snapshot: cbe94a35-6106-485f-a119-045b4f3616ee, volume: 045504a7-9162-426e-8898-79431baf231c, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:57:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Volume volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 (7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4): created successfully Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84637e4f-15e9-4102-a845-456f3129a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Flow 'volume_create_manager' (c5bd906b-09fe-4491-8896-5c402d790810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e70641c-8491-4561-b5db-97b5176afdba]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-48f24de7-d2e6-48d6-9482-3ccff5440b0c tempest-TestServerVolumeAttachmentScenario-2079938435 None] Created volume successfully. Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e4cfa80-eb7c-4e00-af76-6404f9d36a8f req-17b6c7dd-6530-40b0-af0c-abdd94d809ff tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:10 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:10 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:10 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55a5ac-4c4a-46fa-88cf-bb8d1551a52f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:10 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:10 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:11 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.631s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:57:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:57:11 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:57:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:11 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c Sep 02 12:57:11 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:17 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c" returned: 0 in 6.479s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:17 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:57:17 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Converted 1024.00 MB image at 157.99 MB/s Sep 02 12:57:17 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c is being set with open permissions: ugo+rw Sep 02 12:57:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:17 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c Sep 02 12:57:17 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:18 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" released by "_copy_volume_from_snapshot" :: held 8.243s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee-045504a7-9162-426e-8898-79431baf231c" released by "_create_volume_from_snapshot" :: held 8.395s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.445s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e4cfa80-eb7c-4e00-af76-6404f9d36a8f req-17b6c7dd-6530-40b0-af0c-abdd94d809ff tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.127s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e4cfa80-eb7c-4e00-af76-6404f9d36a8f req-17b6c7dd-6530-40b0-af0c-abdd94d809ff tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daff8f75-e226-4824-b10d-e768bdb5d75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045504a7-9162-426e-8898-79431baf231c', 'volume_size': 2, 'snapshot_id': 'cbe94a35-6106-485f-a119-045b4f3616ee'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced5010f-383b-489e-a669-91c6ff7c60c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Volume volume-045504a7-9162-426e-8898-79431baf231c (045504a7-9162-426e-8898-79431baf231c): created successfully Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced5010f-383b-489e-a669-91c6ff7c60c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (cdd19e56-5c32-4e4e-a34a-4e1446424c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9e4cfa80-eb7c-4e00-af76-6404f9d36a8f req-17b6c7dd-6530-40b0-af0c-abdd94d809ff tempest-TestMinimumBasicScenario-1235252650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-5bbab7ae-23bf-4e43-b927-9e859f916584', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc6f1fa6-62db-4f0f-86e6-c82c58036a64', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:57:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-54eef8cb-877d-440d-9b74-27319b2c901e tempest-VolumesSnapshotTestJSON-1274883758 None] Created volume successfully. Sep 02 12:57:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-9e4cfa80-eb7c-4e00-af76-6404f9d36a8f req-17b6c7dd-6530-40b0-af0c-abdd94d809ff tempest-TestMinimumBasicScenario-1235252650 None] attachment_update completed successfully. Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-045504a7-9162-426e-8898-79431baf231c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-045504a7-9162-426e-8898-79431baf231c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75206f-fe11-4e97-b1dc-65def8a7e0c7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:19 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c Sep 02 12:57:19 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:20 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c" returned: 0 in 0.496s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:20 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c Sep 02 12:57:20 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:20 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-045504a7-9162-426e-8898-79431baf231c" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-045504a7-9162-426e-8898-79431baf231c" released by "delete_volume" :: held 0.972s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['231dcf2a-52e5-4385-af87-f3cc36cb66a6', '863a17a9-85c8-48e0-b45e-296dafb630e9', 'f8148bb2-2643-45ed-9510-51b098d0833c', '3139d6d1-6329-484a-8087-811d568f995b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:21 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:21 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:21 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Deleted volume successfully. Sep 02 12:57:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777d08d9-f441-4620-8a2d-a45e5b70daa5 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-045504a7-9162-426e-8898-79431baf231c-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-cbe94a35-6106-485f-a119-045b4f3616ee-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-cbe94a35-6106-485f-a119-045b4f3616ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Deleting offline snapshot cbe94a35-6106-485f-a119-045b4f3616ee of volume 60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] snapshot_file for this snap is: volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164f38e-9b84-4f9b-9cfe-0088e65ce33d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:22 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:22 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:22 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.548s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f6be0-6387-40b7-aaf1-3fc6a6900f48]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:23 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:23 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:23 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.661s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:23 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:23 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:23 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:24 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee Sep 02 12:57:24 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:24 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad.cbe94a35-6106-485f-a119-045b4f3616ee" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-cbe94a35-6106-485f-a119-045b4f3616ee" released by "_delete_snapshot" :: held 2.077s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" released by "delete_snapshot" :: held 2.111s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['ec056660-9bbd-4dfc-a28a-f8847aff8202', 'f61608f0-64bc-4c73-9e2b-f204ca260062', 'ec4c27de-2cf1-49e7-999d-84a8a036ff8c', '765d6d1a-8266-47f3-826a-efc4c3b5bd3f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Delete snapshot completed successfully. Sep 02 12:57:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78ca0b1e-052a-4f60-835f-30fa4ae404f9 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-cbe94a35-6106-485f-a119-045b4f3616ee-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-60ca5e74-6043-4536-a8fb-7e319e71b4ad-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-60ca5e74-6043-4536-a8fb-7e319e71b4ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd871d3-9652-4533-909c-862800bf9ad8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:25 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:25 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:26 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.434s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:26 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad Sep 02 12:57:26 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:26 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-60ca5e74-6043-4536-a8fb-7e319e71b4ad" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-60ca5e74-6043-4536-a8fb-7e319e71b4ad" released by "delete_volume" :: held 0.776s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['ab8a67b2-d37b-4fec-b800-4da7c286ffb2', '67bcb504-abe9-42fa-a5fa-ccc232f99e0f', 'df3d4f40-e3e3-4eb1-8020-d64ecab3232f', 'bc31b847-caab-429e-ba26-c460ade6d0df'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:26 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:26 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:26 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Deleted volume successfully. Sep 02 12:57:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-84a78ef5-f5ca-4748-aa63-be8a4ad165ec tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-60ca5e74-6043-4536-a8fb-7e319e71b4ad-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (e7326c82-7ffa-45c9-8d3d-b711c2276f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12eae81-3b0b-4cc9-adac-8740bd627f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12eae81-3b0b-4cc9-adac-8740bd627f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1215320941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab52a24-3cbe-4c93-9343-0c5ee73e331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:27Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986f024a-3ea3-4727-9b0f-2a13e4f9b8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986f024a-3ea3-4727-9b0f-2a13e4f9b8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127464c5-b1df-4331-ab01-f9f5e03fb0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127464c5-b1df-4331-ab01-f9f5e03fb0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab52a24-3cbe-4c93-9343-0c5ee73e331a', 'volume_name': 'volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca29476-2ed7-42b1-a967-93719964c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca29476-2ed7-42b1-a967-93719964c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c9846-369e-44e7-8fd9-0a4324e91872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume bab52a24-3cbe-4c93-9343-0c5ee73e331a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a', 'volume_size': 1} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1215320941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab52a24-3cbe-4c93-9343-0c5ee73e331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:27Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Creating volume bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:27 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a 1073741824 Sep 02 12:57:27 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:28 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a 1073741824" returned: 0 in 0.669s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:28 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:28 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:28 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c9846-369e-44e7-8fd9-0a4324e91872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e62df03-a7d6-4c01-aa17-10569f95cb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Volume volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a (bab52a24-3cbe-4c93-9343-0c5ee73e331a): created successfully Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e62df03-a7d6-4c01-aa17-10569f95cb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (e7326c82-7ffa-45c9-8d3d-b711c2276f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-76773af3-02ad-4e47-9f1b-841d1d3b7d82 tempest-VolumesSnapshotTestJSON-1274883758 None] Created volume successfully. Sep 02 12:57:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Creating offline snapshot 94ac3d82-7def-4ba7-b1f9-4cfdf406f01c of volume bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:57:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e3c2f-aefb-4565-8e1e-09cb215fe6f7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:30 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:30 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:30 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:30 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c 1G Sep 02 12:57:30 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:30 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c 1G" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:30 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:30 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:31 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c is being set with open permissions: ugo+rw Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:31 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:31 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:31 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:31 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info Sep 02 12:57:31 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:31 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info is being set with open permissions: ugo+rw Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:31 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info Sep 02 12:57:31 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:31 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.info" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3f95fd47-a0d5-41d9-900b-0b987e6093c4 tempest-VolumesSnapshotTestJSON-1274883758 None] Create snapshot completed successfully Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (beec6d69-ded4-40df-8894-12be4e9417d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a66f93-284b-47a7-9b1f-9b44dbfde97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a66f93-284b-47a7-9b1f-9b44dbfde97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-998247917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782f0920-1e3b-490c-b2dd-e54a4aeb71f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60b42ac4ba74cc7ba0f44d514b6908c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=94ac3d82-7def-4ba7-b1f9-4cfdf406f01c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:33Z,use_quota=True,user_id='330df7a60ff84a73b49181a6a6cc4c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbcffec-d57a-48ab-9b9f-531fb50ee275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbcffec-d57a-48ab-9b9f-531fb50ee275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9f369d-564a-4064-bc48-e29332aaffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9f369d-564a-4064-bc48-e29332aaffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '782f0920-1e3b-490c-b2dd-e54a4aeb71f9', 'volume_name': 'volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9', 'volume_size': 1, 'snapshot_id': '94ac3d82-7def-4ba7-b1f9-4cfdf406f01c'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5fc07f-9ad6-4d14-9ff6-f002cf65da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5fc07f-9ad6-4d14-9ff6-f002cf65da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af2b078-a423-48bd-8b71-26745deebeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Volume 782f0920-1e3b-490c-b2dd-e54a4aeb71f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9', 'volume_size': 1, 'snapshot_id': '94ac3d82-7def-4ba7-b1f9-4cfdf406f01c'} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Creating volume 782f0920-1e3b-490c-b2dd-e54a4aeb71f9 from snapshot 94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] snapshot: 94ac3d82-7def-4ba7-b1f9-4cfdf406f01c, volume: 782f0920-1e3b-490c-b2dd-e54a4aeb71f9, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ca125-e8b0-440f-bc21-a4f63db92613]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:33 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:33 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:34 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7594bf9-7bb2-4903-a6ef-4a2c3b2b8ad2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:34 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:34 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:34 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:57:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:34 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 Sep 02 12:57:34 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:37 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:37 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:38 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.669s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:38 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:57:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:57:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:57:39 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" returned: 0 in 4.746s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:57:39 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Converted 1024.00 MB image at 215.70 MB/s Sep 02 12:57:39 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 is being set with open permissions: ugo+rw Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:39 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 Sep 02 12:57:39 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:39 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" released by "_copy_volume_from_snapshot" :: held 5.794s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" released by "_create_volume_from_snapshot" :: held 5.859s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.874s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af2b078-a423-48bd-8b71-26745deebeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9', 'volume_size': 1, 'snapshot_id': '94ac3d82-7def-4ba7-b1f9-4cfdf406f01c'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d97d2a-f5f4-46c0-bd9e-02f0b5607e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Volume volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 (782f0920-1e3b-490c-b2dd-e54a4aeb71f9): created successfully Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d97d2a-f5f4-46c0-bd9e-02f0b5607e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Flow 'volume_create_manager' (beec6d69-ded4-40df-8894-12be4e9417d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-203a9942-528d-45ef-b49d-c21fece1c86f tempest-VolumesSnapshotTestJSON-1274883758 None] Created volume successfully. Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-782f0920-1e3b-490c-b2dd-e54a4aeb71f9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-782f0920-1e3b-490c-b2dd-e54a4aeb71f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914862f-26ce-4b9b-b2f0-7b7348298b00]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:40 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 Sep 02 12:57:40 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:41 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" returned: 0 in 0.523s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:41 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9 Sep 02 12:57:41 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:41 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-782f0920-1e3b-490c-b2dd-e54a4aeb71f9" released by "delete_volume" :: held 0.846s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['116f679b-e3b2-4357-ae2c-a851e422c4fc', 'f467b4ac-808d-426d-a396-a3bafe677370', '83db373f-74bd-4040-bd99-842456686e24', '790c2434-bf8a-4a73-a7d5-e15805df13d0'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:41 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:41 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Deleting offline snapshot 94ac3d82-7def-4ba7-b1f9-4cfdf406f01c of volume bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] snapshot_file for this snap is: volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e810b70-1b32-4344-abbb-79230868979c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:42 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:42 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:42 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.625s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Deleted volume successfully. Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5bdae3ee-cc88-46de-bc39-afecda767d3e tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-782f0920-1e3b-490c-b2dd-e54a4aeb71f9-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:42 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.473s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c903c-f5ef-40e6-bd92-9406dc939795]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:42 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:42 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:43 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.665s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:43 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:43 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-ee05e768-4514-4f1f-bf90-ea8a62f35f08 req-762ff24f-530e-4ee6-8e6c-bbecc1df5e87 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-ee05e768-4514-4f1f-bf90-ea8a62f35f08 req-762ff24f-530e-4ee6-8e6c-bbecc1df5e87 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-ee05e768-4514-4f1f-bf90-ea8a62f35f08 req-762ff24f-530e-4ee6-8e6c-bbecc1df5e87 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ee05e768-4514-4f1f-bf90-ea8a62f35f08 req-762ff24f-530e-4ee6-8e6c-bbecc1df5e87 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35c3c98c-af94-4bd9-85ef-5206677220b3', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:57:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ee05e768-4514-4f1f-bf90-ea8a62f35f08 req-762ff24f-530e-4ee6-8e6c-bbecc1df5e87 tempest-TestServerVolumeAttachmentScenario-2079938435 None] attachment_update completed successfully. Sep 02 12:57:43 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:43 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c Sep 02 12:57:43 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:43 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a.94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c" released by "_delete_snapshot" :: held 2.015s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" released by "delete_snapshot" :: held 2.072s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:43 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['4a9970f3-3f41-4ffc-9a02-e7942afb5523', 'b3ae1d01-cee1-4aaa-aced-fc64b46bec63', '5befd0fd-3ea9-43fa-b0e3-a5ec5a714eb5', '92c97ab7-ef0e-4115-ad32-c61b43fb8aeb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:44 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=85,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=20 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:57:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Delete snapshot completed successfully. Sep 02 12:57:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-47220624-91e3-472e-8c80-5dd511e3b6bf tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-94ac3d82-7def-4ba7-b1f9-4cfdf406f01c-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-bab52a24-3cbe-4c93-9343-0c5ee73e331a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-bab52a24-3cbe-4c93-9343-0c5ee73e331a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=76,cinder:UPDATE=85,cinder:INSERT=15,cinder:DELETE=9 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4c5c51-0b68-4ce7-82a4-e2888b8ae450]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:45 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:45 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:45 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:45 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a Sep 02 12:57:45 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:46 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bab52a24-3cbe-4c93-9343-0c5ee73e331a" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-bab52a24-3cbe-4c93-9343-0c5ee73e331a" released by "delete_volume" :: held 0.778s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['ca695375-fb34-4189-8e83-2f61f78fe45a', '82dd5c26-7615-4fe4-95db-660df13712ec', 'c12df3be-fd11-4d43-9d67-d6fe92ead11c', '061d1826-d1cc-4f00-b8dd-c5227509c324'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:46 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:46 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-5ac67213-b467-49f8-a80d-c0c1bc6127ce-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-5ac67213-b467-49f8-a80d-c0c1bc6127ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:46 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Deleted volume successfully. Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31d18187-0523-446b-af57-fe30f775bfc1 tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-bab52a24-3cbe-4c93-9343-0c5ee73e331a-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4b149-2d1c-4490-bd1c-7826eed8c61f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:46 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce Sep 02 12:57:46 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-77d0f657-9f5d-44a3-9664-55b8f957eb09 req-81f83952-97ad-4b4e-9980-02e48687794a tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-77d0f657-9f5d-44a3-9664-55b8f957eb09 req-81f83952-97ad-4b4e-9980-02e48687794a tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:47 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-77d0f657-9f5d-44a3-9664-55b8f957eb09 req-81f83952-97ad-4b4e-9980-02e48687794a tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:47 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce Sep 02 12:57:47 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-77d0f657-9f5d-44a3-9664-55b8f957eb09 req-81f83952-97ad-4b4e-9980-02e48687794a tempest-TestServerVolumeAttachmentScenario-2079938435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e73da764-511d-4263-ac4d-bfb6325fb6a3', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:57:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-77d0f657-9f5d-44a3-9664-55b8f957eb09 req-81f83952-97ad-4b4e-9980-02e48687794a tempest-TestServerVolumeAttachmentScenario-2079938435 None] attachment_update completed successfully. Sep 02 12:57:47 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5ac67213-b467-49f8-a80d-c0c1bc6127ce" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-quobyte-5ac67213-b467-49f8-a80d-c0c1bc6127ce" released by "delete_volume" :: held 0.776s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Created reservations ['dea3b962-79d4-42a7-86eb-2bf20e207930', '496ae815-5afe-4838-9f03-0116c1ecdb40', '30117eef-1fdd-404f-822b-5efdc2202bfc', '8f2bb703-3202-475a-9a04-a68897ee3501'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:47 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:47 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:47 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Deleted volume successfully. Sep 02 12:57:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6e3ba87d-8b0c-4228-93f7-50402423565b tempest-VolumesSnapshotTestJSON-1274883758 None] Lock "cinder-5ac67213-b467-49f8-a80d-c0c1bc6127ce-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a51afcf3-5c07-4e36-b766-5a1d769a5d70 req-f22ee6d1-31ee-49ac-886d-06551e7a38a2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Terminate volume connection completed successfully. Sep 02 12:57:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a51afcf3-5c07-4e36-b766-5a1d769a5d70 req-f22ee6d1-31ee-49ac-886d-06551e7a38a2 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Deleting attachment e73da764-511d-4263-ac4d-bfb6325fb6a3. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:57:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-46177225-d2c0-456a-8076-1618c4f059e1 req-91fb5db6-2628-4a41-9d15-4e579096aef0 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Terminate volume connection completed successfully. Sep 02 12:57:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-46177225-d2c0-456a-8076-1618c4f059e1 req-91fb5db6-2628-4a41-9d15-4e579096aef0 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Deleting attachment 35c3c98c-af94-4bd9-85ef-5206677220b3. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "cinder-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "cinder-quobyte-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-quobyte-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec16569-bf06-4428-a662-bc80c133e4a2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:55 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 Sep 02 12:57:55 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Flow 'volume_create_manager' (783bb62b-e35d-42c8-9bb2-710018ad21f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9856fcaf-176d-4e45-a449-7f107600318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9856fcaf-176d-4e45-a449-7f107600318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2086320432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da40aeb-0316-4c06-b04a-2d22b4ed04f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9783455417354b92a029ead9d2271e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:56Z,use_quota=True,user_id='6ea47812641f43aca15a9b547236356f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29744c98-dd88-4e95-936f-13816df6c06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29744c98-dd88-4e95-936f-13816df6c06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e675bc-d143-4573-aa6a-e0dda6bb9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e675bc-d143-4573-aa6a-e0dda6bb9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da40aeb-0316-4c06-b04a-2d22b4ed04f3', 'volume_name': 'volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acdc32d-22f1-489d-a7dc-95cf7551bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acdc32d-22f1-489d-a7dc-95cf7551bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edee6ff-b47e-4f09-8c99-ec07dafae779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3', 'volume_size': 1} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2086320432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da40aeb-0316-4c06-b04a-2d22b4ed04f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9783455417354b92a029ead9d2271e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:57:56Z,use_quota=True,user_id='6ea47812641f43aca15a9b547236356f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Creating volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:57:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:56 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 1073741824 Sep 02 12:57:56 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:56 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:56 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4 Sep 02 12:57:56 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:56 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-quobyte-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4" released by "delete_volume" :: held 0.708s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Created reservations ['5a923dfc-2f20-4fd5-93a0-f86e412449be', '574e6d50-5056-464a-bc5d-9221158391e0', '743a6f28-41e9-47a9-81e4-46b6f100cf35', 'cdc0cf41-c73a-45b7-a992-a8b726e54ff2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:56 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 1073741824" returned: 0 in 0.458s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:56 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:56 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:56 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 Sep 02 12:57:56 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:56 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "cinder-08b03c66-6988-4696-b0bb-0ed4ab7db00c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Deleted volume successfully. Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-08b03c66-6988-4696-b0bb-0ed4ab7db00c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:56 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2aef559-7788-4dc0-bbe5-bcc50dc4aab9 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-7a5b7c8e-60f5-4a9f-9da8-a8193d5036f4-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edee6ff-b47e-4f09-8c99-ec07dafae779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d23b0b-0efd-4621-adcc-10039fd89703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:57:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Volume volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 (9da40aeb-0316-4c06-b04a-2d22b4ed04f3): created successfully Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d23b0b-0efd-4621-adcc-10039fd89703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Flow 'volume_create_manager' (783bb62b-e35d-42c8-9bb2-710018ad21f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "cinder-quobyte-08b03c66-6988-4696-b0bb-0ed4ab7db00c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:57:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-40cfb919-4ee3-41ea-ad01-642bd2c651f6 tempest-VolumesSnapshotListTestJSON-1499405435 None] Created volume successfully. Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-quobyte-08b03c66-6988-4696-b0bb-0ed4ab7db00c" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8b26da-ea89-4048-8144-5ccad595d8b9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:57 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c Sep 02 12:57:57 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:57 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:57 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c Sep 02 12:57:57 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:57 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-08b03c66-6988-4696-b0bb-0ed4ab7db00c" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-quobyte-08b03c66-6988-4696-b0bb-0ed4ab7db00c" released by "delete_volume" :: held 0.643s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Created reservations ['f525eb75-df4f-4ecb-9400-aee4c3178bb6', '2356bb6f-d119-4f91-8518-1bc251a8448c', 'e5943ae7-3c7c-41da-9f2b-a15018ae4b29', '9c9ef9b5-b1e5-497c-aff6-6524881a145b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:57 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:57:57 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:57 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:57:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Deleted volume successfully. Sep 02 12:57:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-858e8771-2429-4f77-ba87-5d88d90a55a4 tempest-TestServerVolumeAttachmentScenario-2079938435 None] Lock "cinder-08b03c66-6988-4696-b0bb-0ed4ab7db00c-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Creating offline snapshot 8d01a359-ab20-4c15-8d75-d840f9cfb5a4 of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0aa5e-44bc-4490-9d1a-a1829e65a1c6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:58 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 Sep 02 12:57:58 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:58 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:58 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 1G Sep 02 12:57:58 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:59 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 1G" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:59 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:57:59 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:59 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.374s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:59 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 is being set with open permissions: ugo+rw Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:59 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:57:59 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:57:59 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:57:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:57:59 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info Sep 02 12:57:59 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:00 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:00 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info is being set with open permissions: ugo+rw Sep 02 12:58:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:00 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info Sep 02 12:58:00 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:00 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.info" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0da54b76-1193-4380-b086-8c8055ce5760 tempest-VolumesSnapshotListTestJSON-1499405435 None] Create snapshot completed successfully Sep 02 12:58:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Creating offline snapshot 584aee9d-fb08-42ff-845c-279f896606c4 of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:58:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e569f2a-f9f8-4568-9b89-8ac6ebf2dde4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:01 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:58:01 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:02 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.414s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:02 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 1G Sep 02 12:58:02 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:02 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 1G" returned: 0 in 0.586s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:02 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:02 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:03 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 is being set with open permissions: ugo+rw Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:03 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:03 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:03 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e8ba7708-b745-4f08-b981-e6c22d4e17ad tempest-VolumesSnapshotListTestJSON-1499405435 None] Create snapshot completed successfully Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Creating offline snapshot 262cb438-632f-4261-a74f-e1d887e7a92f of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[58be0314-5338-4bd2-8adf-e7c140de2a9b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:04 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:04 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:04 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:04 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f 1G Sep 02 12:58:04 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:05 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f 1G" returned: 0 in 0.707s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:05 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f Sep 02 12:58:05 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ad8f85fa-c13f-4d94-9233-8cdd88f62032 req-a45f4405-346a-42d1-8d86-ba6dc7e95cd9 tempest-TestMinimumBasicScenario-1235252650 None] Terminate volume connection completed successfully. Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ad8f85fa-c13f-4d94-9233-8cdd88f62032 req-a45f4405-346a-42d1-8d86-ba6dc7e95cd9 tempest-TestMinimumBasicScenario-1235252650 None] Deleting attachment bc6f1fa6-62db-4f0f-86e6-c82c58036a64. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:58:05 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f is being set with open permissions: ugo+rw Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:05 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f Sep 02 12:58:05 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:05 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f" returned: 0 in 0.326s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d24770b-cbca-4ccb-a5e0-ea5c4aaa5f48 tempest-VolumesSnapshotListTestJSON-1499405435 None] Create snapshot completed successfully Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "cinder-5bbab7ae-23bf-4e43-b927-9e859f916584-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "cinder-5bbab7ae-23bf-4e43-b927-9e859f916584-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "cinder-quobyte-5bbab7ae-23bf-4e43-b927-9e859f916584" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "cinder-quobyte-5bbab7ae-23bf-4e43-b927-9e859f916584" acquired by "delete_volume" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5363e3-224a-457e-ad08-397ed528e470]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:06 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 Sep 02 12:58:06 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:06 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:06 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584 Sep 02 12:58:06 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:06 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5bbab7ae-23bf-4e43-b927-9e859f916584" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "cinder-quobyte-5bbab7ae-23bf-4e43-b927-9e859f916584" released by "delete_volume" :: held 0.694s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:06 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Created reservations ['4a291f80-6de1-4a1f-82de-4ef94ed58e97', '53ee4f25-ff99-4f1d-9372-d95b14fcf206', 'be7f654b-4e90-4385-bd5d-ec4a650faa1d', '68e030d7-92e6-4f65-91bc-45ad038caeb6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:07 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:07 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:07 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.293s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Deleted volume successfully. Sep 02 12:58:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-611be18e-670e-445b-91c9-d35adb1ec60b tempest-TestMinimumBasicScenario-1235252650 None] Lock "cinder-5bbab7ae-23bf-4e43-b927-9e859f916584-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-262cb438-632f-4261-a74f-e1d887e7a92f-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-262cb438-632f-4261-a74f-e1d887e7a92f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-262cb438-632f-4261-a74f-e1d887e7a92f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-262cb438-632f-4261-a74f-e1d887e7a92f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Deleting offline snapshot 262cb438-632f-4261-a74f-e1d887e7a92f of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] snapshot_file for this snap is: volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db8ed5a-b154-4c9e-b7cb-018c369b1b8b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:08 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f Sep 02 12:58:08 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:08 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5a448-28d6-4a33-8eff-c95aec4e8950]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:08 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:08 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:09 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.498s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:09 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f Sep 02 12:58:09 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:09 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f" returned: 0 in 0.535s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:09 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f Sep 02 12:58:09 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:10 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.262cb438-632f-4261-a74f-e1d887e7a92f" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-262cb438-632f-4261-a74f-e1d887e7a92f" released by "_delete_snapshot" :: held 1.874s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" released by "delete_snapshot" :: held 1.910s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Created reservations ['1dfaf818-f8e4-4cf1-8c16-9d2e8eff34ff', '426dd8ea-746b-4bce-8a94-37e787c89b7f', '3212ede1-cd69-4fdc-8c00-c5caa040c798', 'de57055b-ae36-4eff-8c19-df6bb7d179a7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Delete snapshot completed successfully. Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1b40d14e-472e-44b9-8346-33428268449a tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-262cb438-632f-4261-a74f-e1d887e7a92f-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-584aee9d-fb08-42ff-845c-279f896606c4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-584aee9d-fb08-42ff-845c-279f896606c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-584aee9d-fb08-42ff-845c-279f896606c4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-584aee9d-fb08-42ff-845c-279f896606c4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Deleting offline snapshot 584aee9d-fb08-42ff-845c-279f896606c4 of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] snapshot_file for this snap is: volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da9a9a-b085-40be-8f94-5aa6feddd173]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:10 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:10 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:10 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[69edcd6e-a074-4673-a9d1-bf92cadf88dc]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:11 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:58:11 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:11 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:11 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:11 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:11 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.463s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:11 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4 Sep 02 12:58:11 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Flow 'volume_create_manager' (bde7b16c-a2b3-4692-8e42-9f1c14a86729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c63479-4ca2-49bc-b5e8-b341fef190f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c63479-4ca2-49bc-b5e8-b341fef190f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1912385384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c5252-1bee-4470-ad99-b212625bb1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889e91793414f4aba9726827b938250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:12Z,use_quota=True,user_id='0e0526b99d8e4729919cc0be8c124d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce3f58-88ef-430d-803f-ae26268b8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce3f58-88ef-430d-803f-ae26268b8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6acf9-bf44-4560-89fe-7ab593fd2d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6acf9-bf44-4560-89fe-7ab593fd2d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441c5252-1bee-4470-ad99-b212625bb1ed', 'volume_name': 'volume-441c5252-1bee-4470-ad99-b212625bb1ed', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7478812e-924a-40c5-9bf5-952b9f813d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7478812e-924a-40c5-9bf5-952b9f813d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22468bc8-3604-4056-98f3-45ba7360e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Volume 441c5252-1bee-4470-ad99-b212625bb1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441c5252-1bee-4470-ad99-b212625bb1ed', 'volume_size': 1} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1912385384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c5252-1bee-4470-ad99-b212625bb1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889e91793414f4aba9726827b938250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:12Z,use_quota=True,user_id='0e0526b99d8e4729919cc0be8c124d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Creating volume 441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:58:12 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:12 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed 1073741824 Sep 02 12:58:12 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:12 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.584aee9d-fb08-42ff-845c-279f896606c4" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-584aee9d-fb08-42ff-845c-279f896606c4" released by "_delete_snapshot" :: held 1.683s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" released by "delete_snapshot" :: held 1.710s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Created reservations ['4b677f75-a835-4866-bc9b-fe18717902ed', 'e36f5395-eef3-49f3-a3c1-3816b2484e66', 'e28d4874-d5e5-400e-9753-9a1f1d29a7e8', '9bc00a97-84a6-4631-90bb-13beb9aed927'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Delete snapshot completed successfully. Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ba04a834-2b0a-4a0f-835c-ad1fd7461b26 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-584aee9d-fb08-42ff-845c-279f896606c4-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:12 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed 1073741824" returned: 0 in 0.487s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:12 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:12 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-8d01a359-ab20-4c15-8d75-d840f9cfb5a4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-8d01a359-ab20-4c15-8d75-d840f9cfb5a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-8d01a359-ab20-4c15-8d75-d840f9cfb5a4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-8d01a359-ab20-4c15-8d75-d840f9cfb5a4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Deleting offline snapshot 8d01a359-ab20-4c15-8d75-d840f9cfb5a4 of volume 9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] snapshot_file for this snap is: volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3db8e2d-d507-4192-849d-3d0637232925]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:12 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22468bc8-3604-4056-98f3-45ba7360e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441c5252-1bee-4470-ad99-b212625bb1ed', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae951f4-4cf8-4ce3-bef5-71aae3835ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Volume volume-441c5252-1bee-4470-ad99-b212625bb1ed (441c5252-1bee-4470-ad99-b212625bb1ed): created successfully Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae951f4-4cf8-4ce3-bef5-71aae3835ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:12 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:58:12 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Flow 'volume_create_manager' (bde7b16c-a2b3-4692-8e42-9f1c14a86729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b842aa51-9152-4c4d-9edf-7d3c035f2dc6 tempest-VolumeDependencyTests-1333875830 None] Created volume successfully. Sep 02 12:58:13 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe01727-9545-4269-bf04-2f420c8029dc]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:13 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 Sep 02 12:58:13 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:13 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:13 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:58:13 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:13 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:13 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4 Sep 02 12:58:13 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:14 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3.8d01a359-ab20-4c15-8d75-d840f9cfb5a4" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-8d01a359-ab20-4c15-8d75-d840f9cfb5a4" released by "_delete_snapshot" :: held 1.496s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" released by "delete_snapshot" :: held 1.524s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Creating offline snapshot e9d136c7-a415-4276-b294-f4bff3c9f479 of volume 441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b842b0f-b631-45e4-8f0e-2d5edda7f379]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Created reservations ['3d52a996-bc4f-4ecf-93f5-ad1b421e920a', 'df61613b-3073-4623-bc45-6afb4f5e6c01', '35609426-58a9-4e6a-83a6-d21655521735', 'e71501f6-77cb-4dfe-a62f-da8376b880a3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Delete snapshot completed successfully. Sep 02 12:58:14 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:14 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-33b5b346-ea98-40fb-9fa6-ba1c7d4a8eec tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-8d01a359-ab20-4c15-8d75-d840f9cfb5a4-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:14 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:14 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 1G Sep 02 12:58:14 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-9da40aeb-0316-4c06-b04a-2d22b4ed04f3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-9da40aeb-0316-4c06-b04a-2d22b4ed04f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e56b05-9c38-4010-80f6-a179d5684278]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:15 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 1G" returned: 0 in 0.516s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441c5252-1bee-4470-ad99-b212625bb1ed -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:15 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441c5252-1bee-4470-ad99-b212625bb1ed -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:15 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:15 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 Sep 02 12:58:15 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:15 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:15 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441c5252-1bee-4470-ad99-b212625bb1ed -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.346s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 is being set with open permissions: ugo+rw Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:15 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3 Sep 02 12:58:15 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:15 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:15 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:15 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:15 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-quobyte-9da40aeb-0316-4c06-b04a-2d22b4ed04f3" released by "delete_volume" :: held 0.772s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:15 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info Sep 02 12:58:15 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:15 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Created reservations ['10a6d570-019c-4985-971d-7ac686ba6aeb', '729a845e-0166-4933-a75e-34b26177f715', 'b6226f7d-3827-469a-a5e7-e93323f57011', 'fb13f97e-77ec-4e89-be6c-b76d783acf72'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:16 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:16 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:16 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info is being set with open permissions: ugo+rw Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:16 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info Sep 02 12:58:16 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:16 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Deleted volume successfully. Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-278f777b-539a-4e83-845b-58810ee95d65 tempest-VolumesSnapshotListTestJSON-1499405435 None] Lock "cinder-9da40aeb-0316-4c06-b04a-2d22b4ed04f3-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:16 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.info" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-678d9551-d901-411d-a0f9-52160e15b8b1 tempest-VolumeDependencyTests-1333875830 None] Create snapshot completed successfully Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Flow 'volume_create_manager' (ad7056ed-4ba2-49ee-91ad-03b376973907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1940396f-8c7f-4594-80cb-11b4e25fa015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1940396f-8c7f-4594-80cb-11b4e25fa015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1025321416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889e91793414f4aba9726827b938250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9d136c7-a415-4276-b294-f4bff3c9f479,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:18Z,use_quota=True,user_id='0e0526b99d8e4729919cc0be8c124d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076cb442-6333-4891-a7bd-92d6a65f6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076cb442-6333-4891-a7bd-92d6a65f6189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5ff220-5d98-4529-af60-d2377110221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5ff220-5d98-4529-af60-d2377110221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6', 'volume_name': 'volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6', 'volume_size': 1, 'snapshot_id': 'e9d136c7-a415-4276-b294-f4bff3c9f479'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f050cf-b684-4eb2-bdae-acb52d0e25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f050cf-b684-4eb2-bdae-acb52d0e25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294fd84c-9066-4250-8228-7d48e00a9636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Volume a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6', 'volume_size': 1, 'snapshot_id': 'e9d136c7-a415-4276-b294-f4bff3c9f479'} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Creating volume a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 from snapshot e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] snapshot: e9d136c7-a415-4276-b294-f4bff3c9f479, volume: a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[406d97c7-2ec1-4343-83ce-2c97558cccd7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:18 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:18 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:18 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-441c5252-1bee-4470-ad99-b212625bb1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df40f4-b1bf-4941-88b4-b878af993206]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:18 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:18 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:19 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:58:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:58:19 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:58:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:19 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 Sep 02 12:58:19 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:24 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" returned: 0 in 5.688s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:58:24 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Converted 1024.00 MB image at 179.99 MB/s Sep 02 12:58:24 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 is being set with open permissions: ugo+rw Sep 02 12:58:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:24 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 Sep 02 12:58:24 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:25 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" released by "_copy_volume_from_snapshot" :: held 6.976s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" released by "_create_volume_from_snapshot" :: held 7.053s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.073s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294fd84c-9066-4250-8228-7d48e00a9636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6', 'volume_size': 1, 'snapshot_id': 'e9d136c7-a415-4276-b294-f4bff3c9f479'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c267121-3bc6-413f-9d83-d70a7b2aa43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Volume volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 (a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6): created successfully Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c267121-3bc6-413f-9d83-d70a7b2aa43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Flow 'volume_create_manager' (ad7056ed-4ba2-49ee-91ad-03b376973907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d9fae67d-bba8-4236-ae0a-79e918140912 tempest-VolumeDependencyTests-1333875830 None] Created volume successfully. Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-e9d136c7-a415-4276-b294-f4bff3c9f479-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-e9d136c7-a415-4276-b294-f4bff3c9f479-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Deleting offline snapshot e9d136c7-a415-4276-b294-f4bff3c9f479 of volume 441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] snapshot_file for this snap is: volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0c5e8-84b8-42a0-8149-631f2423078b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:26 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:26 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:26 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.513s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-441c5252-1bee-4470-ad99-b212625bb1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ae1c0-9d10-48fb-b71d-d28be76f0c19]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:26 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:26 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:27 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.689s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:27 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:27 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:27 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:27 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479 Sep 02 12:58:27 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:28 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed.e9d136c7-a415-4276-b294-f4bff3c9f479" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-e9d136c7-a415-4276-b294-f4bff3c9f479" released by "_delete_snapshot" :: held 2.119s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" released by "delete_snapshot" :: held 2.149s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Created reservations ['82dd2535-ddbe-4e37-bc4a-1764b692c334', '133ad335-b9f6-4498-9e3a-4379b4f1cf22', '1c7305b8-3fd7-4a78-91b8-a6781bdb13d5', '4ae780f4-682e-4a5c-ad5c-9664c21d7003'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Delete snapshot completed successfully. Sep 02 12:58:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5c5e5a79-47fc-4f36-a94c-71fbb33e6475 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-e9d136c7-a415-4276-b294-f4bff3c9f479-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-441c5252-1bee-4470-ad99-b212625bb1ed-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-441c5252-1bee-4470-ad99-b212625bb1ed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a42ad6-e230-46f8-8429-11f8f50a67b7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:29 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:29 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:29 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.458s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:30 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed Sep 02 12:58:30 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:30 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-441c5252-1bee-4470-ad99-b212625bb1ed" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-441c5252-1bee-4470-ad99-b212625bb1ed" released by "delete_volume" :: held 0.849s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Created reservations ['0e94650d-3427-4bed-9881-93bf4c92014d', '06824883-41c3-422d-8d80-f3965708420f', '50842d22-82c1-4ec9-b668-61036114b1e0', '18a2c227-99d1-4e72-af15-87491134154c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:30 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:30 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe5293c-8fe6-4b63-af94-d3f1da59aaeb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:30 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Deleted volume successfully. Sep 02 12:58:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-973f48d3-3454-499b-82a6-58b923591797 tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-441c5252-1bee-4470-ad99-b212625bb1ed-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:30 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 Sep 02 12:58:30 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:31 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" returned: 0 in 0.520s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:31 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6 Sep 02 12:58:31 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:31 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-quobyte-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6" released by "delete_volume" :: held 0.952s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Created reservations ['c4eaa718-e52f-462e-a5c3-9c2ff9cb1232', 'ca993206-deae-42bd-9f18-7831b4b530d3', '36fc67ed-1286-4c07-84d0-fd72c3559cea', '433dd496-b841-4a62-ae03-d728c08b600c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:31 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:31 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:32 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Deleted volume successfully. Sep 02 12:58:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8434c9cd-1c65-4d3b-9cd1-e928203b85fa tempest-VolumeDependencyTests-1333875830 None] Lock "cinder-a649ce27-6f06-4aa5-bbd4-bf1a8ccf1ba6-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:37 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:37 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:37 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:58:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Flow 'volume_create_manager' (2a0a6830-0452-4af0-9309-14332f0ad7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cbd0ad-c872-45ba-ac7b-5c11b834ddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cbd0ad-c872-45ba-ac7b-5c11b834ddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664778181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c591893-7332-49b9-a4c5-0dda86648236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e98dd4439470da951b92bc5c37935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:39Z,use_quota=True,user_id='1c24aa22d92541fab9ba28514120954f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aab214-8387-457e-8afb-ba7b85302827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aab214-8387-457e-8afb-ba7b85302827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38d30a9-64b9-4845-8b50-05b744154cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38d30a9-64b9-4845-8b50-05b744154cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c591893-7332-49b9-a4c5-0dda86648236', 'volume_name': 'volume-8c591893-7332-49b9-a4c5-0dda86648236', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdac1394-3454-4e8a-b77a-88bd2c2671a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdac1394-3454-4e8a-b77a-88bd2c2671a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f42a25-7101-454a-a827-a1679d999fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Volume 8c591893-7332-49b9-a4c5-0dda86648236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c591893-7332-49b9-a4c5-0dda86648236', 'volume_size': 1} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664778181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c591893-7332-49b9-a4c5-0dda86648236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e98dd4439470da951b92bc5c37935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:39Z,use_quota=True,user_id='1c24aa22d92541fab9ba28514120954f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Creating volume 8c591893-7332-49b9-a4c5-0dda86648236 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:58:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:58:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:39 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 1073741824 Sep 02 12:58:39 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:39 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 1073741824" returned: 0 in 0.574s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:39 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 Sep 02 12:58:39 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:39 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f42a25-7101-454a-a827-a1679d999fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c591893-7332-49b9-a4c5-0dda86648236', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55350c84-7d8c-4077-8f8c-fd012908cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Volume volume-8c591893-7332-49b9-a4c5-0dda86648236 (8c591893-7332-49b9-a4c5-0dda86648236): created successfully Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55350c84-7d8c-4077-8f8c-fd012908cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Flow 'volume_create_manager' (2a0a6830-0452-4af0-9309-14332f0ad7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2f4f0ae2-a36f-421b-8fc0-a57f59ea8e5b tempest-ProjectReaderTests-660624171 None] Created volume successfully. Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Acquiring lock "cinder-8c591893-7332-49b9-a4c5-0dda86648236-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "cinder-8c591893-7332-49b9-a4c5-0dda86648236-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Acquiring lock "cinder-quobyte-8c591893-7332-49b9-a4c5-0dda86648236" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "cinder-quobyte-8c591893-7332-49b9-a4c5-0dda86648236" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d567ce-eddb-4ba0-a991-20e5c3c5e74c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:41 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 Sep 02 12:58:41 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:41 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:41 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236 Sep 02 12:58:41 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:42 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-8c591893-7332-49b9-a4c5-0dda86648236" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "cinder-quobyte-8c591893-7332-49b9-a4c5-0dda86648236" released by "delete_volume" :: held 0.785s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Created reservations ['1b14e1fd-3fff-4290-bbbc-2fe182f62814', '5877afe9-0f11-4613-82fa-ce47f8a36a0d', '0db0b840-d1f9-4495-91e4-508f2a50c8b1', '5b7bc855-2ad0-4987-b49d-1f46db2daeee'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:42 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:42 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:42 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Deleted volume successfully. Sep 02 12:58:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-308acc95-8293-42f8-9d44-fd3fea3f069c tempest-ProjectReaderTests-660624171 None] Lock "cinder-8c591893-7332-49b9-a4c5-0dda86648236-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Flow 'volume_create_manager' (ab12fe53-4a40-408c-9bfb-a39b7aeaae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79640b14-d3d7-4ab7-828d-0b70bc6f6711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79640b14-d3d7-4ab7-828d-0b70bc6f6711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695781260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecad83c6-c110-461f-bda1-911f34759004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e98dd4439470da951b92bc5c37935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:43Z,use_quota=True,user_id='1c24aa22d92541fab9ba28514120954f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701f07df-04fe-4bba-b1d0-902558e84001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701f07df-04fe-4bba-b1d0-902558e84001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d810579-a8d0-4988-b820-5e873b5f94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d810579-a8d0-4988-b820-5e873b5f94d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecad83c6-c110-461f-bda1-911f34759004', 'volume_name': 'volume-ecad83c6-c110-461f-bda1-911f34759004', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1163e52-0fa0-4673-b7d9-0585cd7a7ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1163e52-0fa0-4673-b7d9-0585cd7a7ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ac48f-85c0-4bcb-80c0-849853c449c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Volume ecad83c6-c110-461f-bda1-911f34759004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecad83c6-c110-461f-bda1-911f34759004', 'volume_size': 1} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695781260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecad83c6-c110-461f-bda1-911f34759004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e98dd4439470da951b92bc5c37935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:58:43Z,use_quota=True,user_id='1c24aa22d92541fab9ba28514120954f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Creating volume ecad83c6-c110-461f-bda1-911f34759004 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:58:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:43 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 1073741824 Sep 02 12:58:43 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:43 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 1073741824" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:44 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 Sep 02 12:58:44 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:44 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ac48f-85c0-4bcb-80c0-849853c449c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecad83c6-c110-461f-bda1-911f34759004', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdada533-07f3-476e-8c9e-ce6e28791c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:58:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Volume volume-ecad83c6-c110-461f-bda1-911f34759004 (ecad83c6-c110-461f-bda1-911f34759004): created successfully Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdada533-07f3-476e-8c9e-ce6e28791c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Flow 'volume_create_manager' (ab12fe53-4a40-408c-9bfb-a39b7aeaae64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:58:44 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=98,cinder:INSERT=31,cinder:UPDATE=118,cinder:DELETE=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:58:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-07bb3389-98bc-499c-80a3-96127593181c tempest-ProjectReaderTests-660624171 None] Created volume successfully. Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Acquiring lock "cinder-ecad83c6-c110-461f-bda1-911f34759004-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "cinder-ecad83c6-c110-461f-bda1-911f34759004-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=98,cinder:INSERT=28,cinder:UPDATE=113,cinder:DELETE=16 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Acquiring lock "cinder-quobyte-ecad83c6-c110-461f-bda1-911f34759004" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "cinder-quobyte-ecad83c6-c110-461f-bda1-911f34759004" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f752bcc-3143-4c51-8105-1e5e7a5ab0fa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:45 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 Sep 02 12:58:45 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:45 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:46 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004 Sep 02 12:58:46 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:46 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ecad83c6-c110-461f-bda1-911f34759004" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "cinder-quobyte-ecad83c6-c110-461f-bda1-911f34759004" released by "delete_volume" :: held 0.931s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Created reservations ['d752e7a2-de9d-46e9-ae84-3dbf9bc33d17', 'fa57d261-9c2d-42d8-98b1-7c4d3efaa7c5', '38aeda06-5135-4a5b-b3df-b4a7bc3403f5', 'f150235e-8499-4065-b0f2-b98127fcd42a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:58:46 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:58:46 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:58:46 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:58:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:58:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Deleted volume successfully. Sep 02 12:58:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b0737290-0d73-4d1f-8a59-7aba06e4ef23 tempest-ProjectReaderTests-660624171 None] Lock "cinder-ecad83c6-c110-461f-bda1-911f34759004-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:58:56 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:58:56 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:59:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Flow 'volume_create_manager' (8958c49c-d20c-43ec-8405-6038383e1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b4618f-c459-404a-aff8-4425286f6d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b4618f-c459-404a-aff8-4425286f6d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-714990038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770bac61-f28e-4d0e-9903-e5fb22b7fbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bda4aed934518aaac4ca9af0190b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:01Z,use_quota=True,user_id='929129e72e0b4889ae023b7256c2850c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88088288-3481-439c-8f1a-12826ec87ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88088288-3481-439c-8f1a-12826ec87ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a9dd8b-31c2-4d1c-a5f5-b816777c3ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a9dd8b-31c2-4d1c-a5f5-b816777c3ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'volume_name': 'volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d183ca-5870-410d-b035-d20abba099b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d183ca-5870-410d-b035-d20abba099b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4134288c-a0eb-4e7c-89d0-553ed1c74ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 12:59:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Trying to clone 770bac61-f28e-4d0e-9903-e5fb22b7fbfc from image 522e45ed-34d8-4082-932f-8d27db1e62a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 12:59:02 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 12:59:02 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Image download 20.69 MB at 20.69 MB/s Sep 02 12:59:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1472036c-32cf-419a-8618-2e0cb4652d41]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:02 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD Sep 02 12:59:02 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:02 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:02 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 is fetched for user 929129e72e0b4889ae023b7256c2850c. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec06cab-3aba-4d64-94fc-2c901953f555]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:03 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD Sep 02 12:59:03 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:03 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-714990038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770bac61-f28e-4d0e-9903-e5fb22b7fbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bda4aed934518aaac4ca9af0190b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:01Z,use_quota=True,user_id='929129e72e0b4889ae023b7256c2850c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Creating volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:59:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:59:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:03 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1073741824 Sep 02 12:59:03 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:04 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1073741824" returned: 0 in 0.880s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:04 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc Sep 02 12:59:04 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:04 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:04 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Attempting download of 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 12:59:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207ca64-8e77-4923-95b6-618f1ca38c9a]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:05 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq Sep 02 12:59:05 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:05 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq" returned: 0 in 0.585s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:05 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq Sep 02 12:59:05 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:06 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq" returned: 1 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_522e45ed-34d8-4082-932f-8d27db1e62a2_g2xdi_bq' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7e34f-2c2c-419e-a45d-cb06c7b1a150]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:06 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD Sep 02 12:59:06 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:06 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] 522e45ed-34d8-4082-932f-8d27db1e62a2 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 12:59:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:06 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc Sep 02 12:59:06 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:09 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" returned: 0 in 2.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_522e45ed-34d8-4082-932f-8d27db1e62a2_qrtzshcvdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:59:09 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Converted 112.00 MB image at 46.56 MB/s Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:09 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1G Sep 02 12:59:09 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:09 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc 1G" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Downloaded image 522e45ed-34d8-4082-932f-8d27db1e62a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}])) to volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Temporary image 522e45ed-34d8-4082-932f-8d27db1e62a2 for user 929129e72e0b4889ae023b7256c2850c is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Marking volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Copying metadata from image 522e45ed-34d8-4082-932f-8d27db1e62a2 to 770bac61-f28e-4d0e-9903-e5fb22b7fbfc. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Creating volume glance metadata for volume 770bac61-f28e-4d0e-9903-e5fb22b7fbfc backed by image 522e45ed-34d8-4082-932f-8d27db1e62a2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4134288c-a0eb-4e7c-89d0-553ed1c74ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'volume_size': 1, 'image_id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/522e45ed-34d8-4082-932f-8d27db1e62a2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75e98d076d074cbfa47a721b4c5bf0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '522e45ed-34d8-4082-932f-8d27db1e62a2', 'created_at': datetime.datetime(2026, 9, 2, 10, 39, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 10, 39, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/522e45ed-34d8-4082-932f-8d27db1e62a2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8df64d0-294c-4f35-8651-daac63efe99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Volume volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc (770bac61-f28e-4d0e-9903-e5fb22b7fbfc): created successfully Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8df64d0-294c-4f35-8651-daac63efe99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Flow 'volume_create_manager' (8958c49c-d20c-43ec-8405-6038383e1f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e6d88d9-dc2c-4d03-9387-9e2e341d7119 tempest-TestShelveInstance-1341661028 None] Created volume successfully. Sep 02 12:59:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-179d2c84-4f3f-415e-93e6-911333cdbd54 req-f26f8166-1c1c-4207-9511-6a7e0e83dd04 tempest-TestShelveInstance-1341661028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-179d2c84-4f3f-415e-93e6-911333cdbd54 req-f26f8166-1c1c-4207-9511-6a7e0e83dd04 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-179d2c84-4f3f-415e-93e6-911333cdbd54 req-f26f8166-1c1c-4207-9511-6a7e0e83dd04 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-179d2c84-4f3f-415e-93e6-911333cdbd54 req-f26f8166-1c1c-4207-9511-6a7e0e83dd04 tempest-TestShelveInstance-1341661028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08332859-0197-4ed6-889a-83bb79e8ac2c', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:59:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-179d2c84-4f3f-415e-93e6-911333cdbd54 req-f26f8166-1c1c-4207-9511-6a7e0e83dd04 tempest-TestShelveInstance-1341661028 None] attachment_update completed successfully. Sep 02 12:59:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:59:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Flow 'volume_create_manager' (51d8a656-e966-4b27-b28e-c88190b95a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645df770-e7f0-49e6-93bf-3f2a92af5d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645df770-e7f0-49e6-93bf-3f2a92af5d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-32106287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f945de-b967-46e4-8f9c-20c7208fe50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc37e4643d04bdd945d07d0e82d6250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:19Z,use_quota=True,user_id='22661241603f47b5b2ba380c465a6b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f985a4bd-347b-432d-8ed9-d5069b43b808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f985a4bd-347b-432d-8ed9-d5069b43b808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393ade6-9c6a-4f01-9c9e-bc49c3078c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393ade6-9c6a-4f01-9c9e-bc49c3078c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f945de-b967-46e4-8f9c-20c7208fe50c', 'volume_name': 'volume-a2f945de-b967-46e4-8f9c-20c7208fe50c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048a0be8-1174-4a93-a939-216d07b64629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048a0be8-1174-4a93-a939-216d07b64629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1bcc1c-9f33-4153-a72b-f07eb336a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Volume a2f945de-b967-46e4-8f9c-20c7208fe50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f945de-b967-46e4-8f9c-20c7208fe50c', 'volume_size': 1} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-32106287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f945de-b967-46e4-8f9c-20c7208fe50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc37e4643d04bdd945d07d0e82d6250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:19Z,use_quota=True,user_id='22661241603f47b5b2ba380c465a6b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Creating volume a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:59:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:19 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c 1073741824 Sep 02 12:59:19 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:19 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c 1073741824" returned: 0 in 0.801s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:20 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:20 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:20 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1bcc1c-9f33-4153-a72b-f07eb336a6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f945de-b967-46e4-8f9c-20c7208fe50c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f448864-6fdc-4643-b155-ad5eddff02c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Volume volume-a2f945de-b967-46e4-8f9c-20c7208fe50c (a2f945de-b967-46e4-8f9c-20c7208fe50c): created successfully Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f448864-6fdc-4643-b155-ad5eddff02c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Flow 'volume_create_manager' (51d8a656-e966-4b27-b28e-c88190b95a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cfd45c80-ac4c-4f6d-b121-b3c606ad8f12 tempest-SnapshotDependencyTests-1115698093 None] Created volume successfully. Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Creating offline snapshot 52eacccb-004e-4d46-84b3-c079ddfbbfb2 of volume a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e7f7b6-ffd0-4253-ada8-b52857b88b74]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:21 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:21 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:21 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:21 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 1G Sep 02 12:59:21 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:22 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 1G" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f945de-b967-46e4-8f9c-20c7208fe50c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:22 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f945de-b967-46e4-8f9c-20c7208fe50c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:22 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:22 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f945de-b967-46e4-8f9c-20c7208fe50c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:22 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 is being set with open permissions: ugo+rw Sep 02 12:59:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:22 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:22 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:23 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:23 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info Sep 02 12:59:23 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:23 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:23 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info is being set with open permissions: ugo+rw Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:23 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info Sep 02 12:59:23 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:23 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.info" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-67c8f298-cfd6-4cc9-a0f8-d933511fcce6 tempest-SnapshotDependencyTests-1115698093 None] Create snapshot completed successfully Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Flow 'volume_create_manager' (22fcb8c4-eba2-4a83-9db7-3a840d00c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b898f522-d989-4392-b578-412baf64465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b898f522-d989-4392-b578-412baf64465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc281e2d-0187-4292-bfd1-da08fedfe220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc37e4643d04bdd945d07d0e82d6250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52eacccb-004e-4d46-84b3-c079ddfbbfb2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:25Z,use_quota=True,user_id='22661241603f47b5b2ba380c465a6b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eddd95d-1429-4a4e-ac0e-eca8eed8810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eddd95d-1429-4a4e-ac0e-eca8eed8810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b60c14-6435-4807-911f-a4df0d757b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b60c14-6435-4807-911f-a4df0d757b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc281e2d-0187-4292-bfd1-da08fedfe220', 'volume_name': 'volume-cc281e2d-0187-4292-bfd1-da08fedfe220', 'volume_size': 1, 'snapshot_id': '52eacccb-004e-4d46-84b3-c079ddfbbfb2'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58f939b-943e-454c-9fc3-80091ca0f20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58f939b-943e-454c-9fc3-80091ca0f20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986c42e4-6944-4e71-b190-67703c8e54b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Volume cc281e2d-0187-4292-bfd1-da08fedfe220: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc281e2d-0187-4292-bfd1-da08fedfe220', 'volume_size': 1, 'snapshot_id': '52eacccb-004e-4d46-84b3-c079ddfbbfb2'} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2-cc281e2d-0187-4292-bfd1-da08fedfe220" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2-cc281e2d-0187-4292-bfd1-da08fedfe220" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Creating volume cc281e2d-0187-4292-bfd1-da08fedfe220 from snapshot 52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] snapshot: 52eacccb-004e-4d46-84b3-c079ddfbbfb2, volume: cc281e2d-0187-4292-bfd1-da08fedfe220, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7881294-e672-4dc1-9f10-918eb13f6593]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:25 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:25 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:26 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2f945de-b967-46e4-8f9c-20c7208fe50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5596145d-4f52-4314-b873-3eca60218862]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:26 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:26 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:26 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 12:59:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:26 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 Sep 02 12:59:26 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Flow 'volume_create_manager' (0fa54620-2d63-47c5-a017-918ec98af7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7878a7-5d03-4012-b199-970be2e5d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7878a7-5d03-4012-b199-970be2e5d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1457539114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86ce677-ac8b-4422-a61e-ec34c61d8d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1beea331fc4451a5175d12a703fc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:29Z,use_quota=True,user_id='4e5db65da6e246d0a8669965ff3a2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a990bd-842c-43ff-8191-4a2333d4cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a990bd-842c-43ff-8191-4a2333d4cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffda21e0-d558-4e9a-bf06-8b8a0ad46e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffda21e0-d558-4e9a-bf06-8b8a0ad46e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86ce677-ac8b-4422-a61e-ec34c61d8d22', 'volume_name': 'volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c71ab2-863b-4ac0-966c-e88c100a6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c71ab2-863b-4ac0-966c-e88c100a6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc5a571-eb46-49e7-a91a-f74661e80f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Volume e86ce677-ac8b-4422-a61e-ec34c61d8d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22', 'volume_size': 1} Sep 02 12:59:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:32 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220" returned: 0 in 5.733s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 12:59:32 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Converted 1024.00 MB image at 178.57 MB/s Sep 02 12:59:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 is being set with open permissions: ugo+rw Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:32 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 Sep 02 12:59:32 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:32 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" released by "_copy_volume_from_snapshot" :: held 6.833s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2-cc281e2d-0187-4292-bfd1-da08fedfe220" released by "_create_volume_from_snapshot" :: held 6.999s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T10:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1457539114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86ce677-ac8b-4422-a61e-ec34c61d8d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1beea331fc4451a5175d12a703fc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T10:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T10:59:29Z,use_quota=True,user_id='4e5db65da6e246d0a8669965ff3a2227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Creating volume e86ce677-ac8b-4422-a61e-ec34c61d8d22 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 12:59:32 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:32 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 1073741824 Sep 02 12:59:32 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986c42e4-6944-4e71-b190-67703c8e54b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc281e2d-0187-4292-bfd1-da08fedfe220', 'volume_size': 1, 'snapshot_id': '52eacccb-004e-4d46-84b3-c079ddfbbfb2'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519854c-3668-4314-abc2-d0c7b75b6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Volume volume-cc281e2d-0187-4292-bfd1-da08fedfe220 (cc281e2d-0187-4292-bfd1-da08fedfe220): created successfully Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519854c-3668-4314-abc2-d0c7b75b6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Flow 'volume_create_manager' (22fcb8c4-eba2-4a83-9db7-3a840d00c20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-de08a2a1-821a-4172-b605-aab5557df15f tempest-SnapshotDependencyTests-1115698093 None] Created volume successfully. Sep 02 12:59:33 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 1073741824" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:33 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 Sep 02 12:59:33 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:33 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc5a571-eb46-49e7-a91a-f74661e80f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99973ba6-1b46-44ae-b543-74e2a42a7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 12:59:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Volume volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 (e86ce677-ac8b-4422-a61e-ec34c61d8d22): created successfully Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99973ba6-1b46-44ae-b543-74e2a42a7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Flow 'volume_create_manager' (0fa54620-2d63-47c5-a017-918ec98af7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 12:59:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-327fd5f5-0056-4fb0-a684-c998c1138e6f tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Created volume successfully. Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-52eacccb-004e-4d46-84b3-c079ddfbbfb2-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-52eacccb-004e-4d46-84b3-c079ddfbbfb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Deleting offline snapshot 52eacccb-004e-4d46-84b3-c079ddfbbfb2 of volume a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] snapshot_file for this snap is: volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475d6bb-6d4f-48a1-825f-a4e89cc6e26d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:33 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:33 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:34 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2f945de-b967-46e4-8f9c-20c7208fe50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8e880-ddd9-4d07-be60-db3c5a428380]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:34 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:34 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c8c78234-3541-4275-aa31-990ed96a075f req-79d2964f-0152-4abd-86f1-1015391c0ad4 tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c8c78234-3541-4275-aa31-990ed96a075f req-79d2964f-0152-4abd-86f1-1015391c0ad4 tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c8c78234-3541-4275-aa31-990ed96a075f req-79d2964f-0152-4abd-86f1-1015391c0ad4 tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c8c78234-3541-4275-aa31-990ed96a075f req-79d2964f-0152-4abd-86f1-1015391c0ad4 tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbf51db4-02f1-4cfe-904c-72f46d69acbc', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 12:59:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c8c78234-3541-4275-aa31-990ed96a075f req-79d2964f-0152-4abd-86f1-1015391c0ad4 tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] attachment_update completed successfully. Sep 02 12:59:34 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.596s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:34 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:34 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:35 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:35 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2 Sep 02 12:59:35 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:35 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c.52eacccb-004e-4d46-84b3-c079ddfbbfb2" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-52eacccb-004e-4d46-84b3-c079ddfbbfb2" released by "_delete_snapshot" :: held 1.907s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" released by "delete_snapshot" :: held 1.938s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Created reservations ['010ba5c2-28e0-4423-a95b-f27b3fc6cae2', '9a586f3c-9bb6-4928-a8fa-308ddfabd8d8', 'e04ea6ad-491e-441b-a67c-d87dcdb69483', '7f908714-a420-495a-b2f1-22e858518248'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:59:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Delete snapshot completed successfully. Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60ce57d7-adea-4a87-b284-22f92ab29782 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-52eacccb-004e-4d46-84b3-c079ddfbbfb2-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-a2f945de-b967-46e4-8f9c-20c7208fe50c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-a2f945de-b967-46e4-8f9c-20c7208fe50c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[36475f51-a3df-4417-b39f-abcfd5168f3c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:36 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:36 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:36 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:36 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c Sep 02 12:59:36 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ee3e7659-5989-4e1c-85d7-fd5ad105f706 req-e46a1a1c-0d6e-429e-aa37-ab0e891358ed tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Terminate volume connection completed successfully. Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ee3e7659-5989-4e1c-85d7-fd5ad105f706 req-e46a1a1c-0d6e-429e-aa37-ab0e891358ed tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Deleting attachment bbf51db4-02f1-4cfe-904c-72f46d69acbc. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 12:59:36 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a2f945de-b967-46e4-8f9c-20c7208fe50c" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-a2f945de-b967-46e4-8f9c-20c7208fe50c" released by "delete_volume" :: held 0.814s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Created reservations ['49c1f181-0b02-4155-aec5-86f1548a3f7e', 'd086b6df-8380-4b40-b076-d23225ecbd7a', '8e0e4347-b728-435d-a5df-5b6403d9ea9d', 'feb2699e-6ffa-4af6-a249-7eea27c1769d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:36 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:59:36 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:37 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:59:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Deleted volume successfully. Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b40b8c7-6c9c-4577-a608-01607c88575e tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-a2f945de-b967-46e4-8f9c-20c7208fe50c-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-cc281e2d-0187-4292-bfd1-da08fedfe220-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-cc281e2d-0187-4292-bfd1-da08fedfe220-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b091badc-c187-4f53-a7ab-9a0c1a70dc77]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:37 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:59:37 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:37 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 Sep 02 12:59:37 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "cinder-e86ce677-ac8b-4422-a61e-ec34c61d8d22-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "cinder-e86ce677-ac8b-4422-a61e-ec34c61d8d22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "cinder-quobyte-e86ce677-ac8b-4422-a61e-ec34c61d8d22" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "cinder-quobyte-e86ce677-ac8b-4422-a61e-ec34c61d8d22" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 12:59:37 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[399980ad-8e15-4769-9f8d-b6e4655668c9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 12:59:37 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:37 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220 Sep 02 12:59:37 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:37 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 Sep 02 12:59:37 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:38 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cc281e2d-0187-4292-bfd1-da08fedfe220" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-quobyte-cc281e2d-0187-4292-bfd1-da08fedfe220" released by "delete_volume" :: held 0.739s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Created reservations ['a532e288-7709-4a6d-8313-a2b8cdc71945', '48432079-c3b9-4f42-a710-082d533cce4d', 'c1bc35bc-dfde-4921-9a8f-f316d2eafb2b', 'b4498fb4-b81b-411e-a926-47a4bd17092e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:59:38 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:38 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22 Sep 02 12:59:38 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:38 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:59:38 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:38 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-e86ce677-ac8b-4422-a61e-ec34c61d8d22" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:38 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "cinder-quobyte-e86ce677-ac8b-4422-a61e-ec34c61d8d22" released by "delete_volume" :: held 0.738s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:59:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Deleted volume successfully. Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6b0df7b8-c1ce-4826-85f2-e2be7193fa79 tempest-SnapshotDependencyTests-1115698093 None] Lock "cinder-cc281e2d-0187-4292-bfd1-da08fedfe220-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Created reservations ['ef067867-1eaf-438c-8216-e3e48d9e9eb6', '02a2e14d-0335-4f29-b2c3-09e55ccb0c5a', 'b72c94ed-0b07-46fd-88ac-98b780762813', '07303220-1550-4e56-8d76-b0c9e5192113'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 12:59:38 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 12:59:38 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 12:59:38 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 12:59:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Deleted volume successfully. Sep 02 12:59:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ded7a3a-89ce-4695-b230-5c8f874f4a1c tempest-TestServerVolumeAttachScenarioOldVersion-1121770451 None] Lock "cinder-e86ce677-ac8b-4422-a61e-ec34c61d8d22-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 12:59:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=54,cinder:SELECT=53,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 12:59:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=58,cinder:UPDATE=42,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:00:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c3790b78-811b-4802-9278-ef2af856922f req-48ecda64-2e10-4598-8f1e-d86698d3e7a2 tempest-TestShelveInstance-1341661028 None] Terminate volume connection completed successfully. Sep 02 13:00:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c3790b78-811b-4802-9278-ef2af856922f req-48ecda64-2e10-4598-8f1e-d86698d3e7a2 tempest-TestShelveInstance-1341661028 None] Deleting attachment 08332859-0197-4ed6-889a-83bb79e8ac2c. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 13:00:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3717880b-f7d6-4f5e-96e7-5ba279ae10b2 req-a573cfa0-5fd5-436b-a51b-1a883bd68a43 tempest-TestShelveInstance-1341661028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3717880b-f7d6-4f5e-96e7-5ba279ae10b2 req-a573cfa0-5fd5-436b-a51b-1a883bd68a43 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3717880b-f7d6-4f5e-96e7-5ba279ae10b2 req-a573cfa0-5fd5-436b-a51b-1a883bd68a43 tempest-TestShelveInstance-1341661028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-3717880b-f7d6-4f5e-96e7-5ba279ae10b2 req-a573cfa0-5fd5-436b-a51b-1a883bd68a43 tempest-TestShelveInstance-1341661028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd80bbc3a-4390-4cd3-a1d4-052ef0dc1c42', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 13:00:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-3717880b-f7d6-4f5e-96e7-5ba279ae10b2 req-a573cfa0-5fd5-436b-a51b-1a883bd68a43 tempest-TestShelveInstance-1341661028 None] attachment_update completed successfully. Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Flow 'volume_create_manager' (e3c649ec-6b80-402a-912a-03f964b802b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f41b888-d970-426d-90c1-aac97b1961cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f41b888-d970-426d-90c1-aac97b1961cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-236119934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79223475-e68b-400e-b03c-2fe65cf395a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd17d2c78dfe4e6c943c836428495ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:00:17Z,use_quota=True,user_id='40f5385231e64b2bb37867e4c0e92712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cefd4c-7f2b-407f-aa9e-3c94347e1479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cefd4c-7f2b-407f-aa9e-3c94347e1479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436d017-c3d1-48a4-b2c9-0e80852a406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436d017-c3d1-48a4-b2c9-0e80852a406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79223475-e68b-400e-b03c-2fe65cf395a7', 'volume_name': 'volume-79223475-e68b-400e-b03c-2fe65cf395a7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e425cafb-db4c-4b3c-894d-3e725d755341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e425cafb-db4c-4b3c-894d-3e725d755341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc22ed-ec72-4f7e-8148-5907ad3190e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Volume 79223475-e68b-400e-b03c-2fe65cf395a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79223475-e68b-400e-b03c-2fe65cf395a7', 'volume_size': 1} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-236119934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79223475-e68b-400e-b03c-2fe65cf395a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd17d2c78dfe4e6c943c836428495ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:00:17Z,use_quota=True,user_id='40f5385231e64b2bb37867e4c0e92712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Creating volume 79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:00:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:00:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:16 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 1073741824 Sep 02 13:00:16 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:17 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 1073741824" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:17 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:17 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:17 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc22ed-ec72-4f7e-8148-5907ad3190e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79223475-e68b-400e-b03c-2fe65cf395a7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704bf53-3fdf-47e3-9130-26ca6160e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:00:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Volume volume-79223475-e68b-400e-b03c-2fe65cf395a7 (79223475-e68b-400e-b03c-2fe65cf395a7): created successfully Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704bf53-3fdf-47e3-9130-26ca6160e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:00:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Flow 'volume_create_manager' (e3c649ec-6b80-402a-912a-03f964b802b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:00:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-48ab27ec-f97c-48ff-8fad-05358b23e26a tempest-TestImageHashVerification-747655733 None] Created volume successfully. Sep 02 13:00:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfe30b9-e0e2-461d-92e0-41cfb0e08569]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:00:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:19 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:19 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:20 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a1092-5351-4b27-94f9-758da8997ba0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:00:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:20 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:20 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:20 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 /opt/stack/data/cinder/conversion/79223475-e68b-400e-b03c-2fe65cf395a7.temp_image.4b88b75a-8e13-4a7a-a334-18c985c39990bvswopag.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:20 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 /opt/stack/data/cinder/conversion/79223475-e68b-400e-b03c-2fe65cf395a7.temp_image.4b88b75a-8e13-4a7a-a334-18c985c39990bvswopag.img Sep 02 13:00:20 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:25 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 /opt/stack/data/cinder/conversion/79223475-e68b-400e-b03c-2fe65cf395a7.temp_image.4b88b75a-8e13-4a7a-a334-18c985c39990bvswopag.img" returned: 0 in 4.887s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e577a2-3cba-43c0-ab01-0d3516cee072]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:25 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:25 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:25 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.560s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/conversion/79223475-e68b-400e-b03c-2fe65cf395a7.temp_image.4b88b75a-8e13-4a7a-a334-18c985c39990bvswopag.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:00:25 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Converted 1024.00 MB image at 209.48 MB/s Sep 02 13:00:25 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] 4b88b75a-8e13-4a7a-a334-18c985c39990 was raw, no need to convert to raw {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 13:00:35 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:00:35 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:37 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:00:37 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:37 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:00:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:00:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.672s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Uploaded volume to glance image-id: 4b88b75a-8e13-4a7a-a334-18c985c39990. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 13:00:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-987728db-9695-4a67-a291-6ec7e696d6d8 tempest-TestImageHashVerification-747655733 None] Copy volume to image completed successfully. Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Acquiring lock "cinder-79223475-e68b-400e-b03c-2fe65cf395a7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "cinder-79223475-e68b-400e-b03c-2fe65cf395a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Acquiring lock "cinder-quobyte-79223475-e68b-400e-b03c-2fe65cf395a7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "cinder-quobyte-79223475-e68b-400e-b03c-2fe65cf395a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4d1c6e-a53d-4e04-ae25-200de2033ce6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:45 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:45 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:45 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:45 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7 Sep 02 13:00:45 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:45 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-79223475-e68b-400e-b03c-2fe65cf395a7" returned: 0 in 0.232s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "cinder-quobyte-79223475-e68b-400e-b03c-2fe65cf395a7" released by "delete_volume" :: held 0.607s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Created reservations ['38fcba6d-acc6-41a6-94db-35e6b516b29f', 'a913f29b-4519-4816-840c-fa34d8c74038', '67a6d10c-0c8e-4d76-9e42-df62c5dfc7a2', '551f2273-586b-40f7-8dbb-6a25f1285764'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:45 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:00:45 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:46 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:00:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Deleted volume successfully. Sep 02 13:00:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c5410dc5-c908-443c-9555-b59b0d78b401 tempest-TestImageHashVerification-747655733 None] Lock "cinder-79223475-e68b-400e-b03c-2fe65cf395a7-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:00:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-d3cb2b1c-880e-44a5-9661-6b81baa1c556 tempest-TestShelveInstance-1341661028 None] Terminate volume connection completed successfully. Sep 02 13:00:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-d3cb2b1c-880e-44a5-9661-6b81baa1c556 tempest-TestShelveInstance-1341661028 None] Deleting attachment d80bbc3a-4390-4cd3-a1d4-052ef0dc1c42. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Acquiring lock "cinder-770bac61-f28e-4d0e-9903-e5fb22b7fbfc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "cinder-770bac61-f28e-4d0e-9903-e5fb22b7fbfc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Acquiring lock "cinder-quobyte-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "cinder-quobyte-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f819e524-b73e-4ef3-b280-f708227d5470]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:52 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc Sep 02 13:00:52 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:52 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:52 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc Sep 02 13:00:52 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:52 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "cinder-quobyte-770bac61-f28e-4d0e-9903-e5fb22b7fbfc" released by "delete_volume" :: held 0.770s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.quota [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Created reservations ['12ef0fc1-09a5-42d1-8302-8f631bb61c91', '154d9d25-39e3-4e1f-a962-ca2f006170ac', 'b2aef27d-dd8f-41f7-a69b-495581fcf061', '15b78d01-c5ab-4804-a241-f5fc2d59d8f2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:00:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:00:53 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:00:53 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:00:53 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 02 13:00:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:00:53 devstack cinder-volume[87092]: DEBUG cinder.manager [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:00:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Deleted volume successfully. Sep 02 13:00:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a49a2eb9-fac4-4f6b-b41f-89c71f8fb4da req-b761cad2-4394-4e57-a0e1-b37587a1584f tempest-TestShelveInstance-1341661028 None] Lock "cinder-770bac61-f28e-4d0e-9903-e5fb22b7fbfc-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Flow 'volume_create_manager' (7ca33af9-671c-444d-a56f-83fdea5342d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0fb49f-bf1f-411c-a410-09ae17bd9de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0fb49f-bf1f-411c-a410-09ae17bd9de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca09e38-11bb-47dd-8a27-84f52184a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a5e3d610ce4721bbaca7499d4ed1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:02Z,use_quota=True,user_id='6beea80322be43afbc4798c447612433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d465a07-1294-4fa7-9c46-a0b218337576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d465a07-1294-4fa7-9c46-a0b218337576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2f2df4-0562-4e3a-b134-72ef1774fccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:01 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2f2df4-0562-4e3a-b134-72ef1774fccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cca09e38-11bb-47dd-8a27-84f52184a053', 'volume_name': 'volume-cca09e38-11bb-47dd-8a27-84f52184a053', 'volume_size': 1, 'image_id': '9623d5da-1493-4679-9f94-35a469e47a44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '256e792b15d5e3d4e8839790fd395433', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4a5e3d610ce4721bbaca7499d4ed1fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6a70b0a044e1523837936b75147f4941ec240c009617682f1fc8306b92e814da0b7c1ac9159171225d7e3c680551e071912ff0dc6b904eaa7a297a5ff5024dc', 'id': '9623d5da-1493-4679-9f94-35a469e47a44', 'created_at': datetime.datetime(2026, 9, 2, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 1, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9623d5da-1493-4679-9f94-35a469e47a44/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e7ea81-940b-4f97-846e-b9b55726b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e7ea81-940b-4f97-846e-b9b55726b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fbaf90-200b-4079-b881-b7c86161406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Volume cca09e38-11bb-47dd-8a27-84f52184a053: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cca09e38-11bb-47dd-8a27-84f52184a053', 'volume_size': 1, 'image_id': '9623d5da-1493-4679-9f94-35a469e47a44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '256e792b15d5e3d4e8839790fd395433', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4a5e3d610ce4721bbaca7499d4ed1fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6a70b0a044e1523837936b75147f4941ec240c009617682f1fc8306b92e814da0b7c1ac9159171225d7e3c680551e071912ff0dc6b904eaa7a297a5ff5024dc', 'id': '9623d5da-1493-4679-9f94-35a469e47a44', 'created_at': datetime.datetime(2026, 9, 2, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 1, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9623d5da-1493-4679-9f94-35a469e47a44/file', 'properties': {}}, 'image_service': } Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Trying to clone cca09e38-11bb-47dd-8a27-84f52184a053 from image 9623d5da-1493-4679-9f94-35a469e47a44 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 13:01:02 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Image download 0.00 MB at 0.00 MB/s Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[985cdbf8-a63e-4579-8392-4679a47cc740]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:02 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:02 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:02 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:02 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:02 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:03 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Temporary image 9623d5da-1493-4679-9f94-35a469e47a44 is fetched for user 6beea80322be43afbc4798c447612433. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4cbb82-67d4-4ec5-9465-fe40191754bb]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:03 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:03 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:03 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:03 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:03 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:03 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca09e38-11bb-47dd-8a27-84f52184a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a5e3d610ce4721bbaca7499d4ed1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:02Z,use_quota=True,user_id='6beea80322be43afbc4798c447612433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Creating volume cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:01:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:01:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:03 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1073741824 Sep 02 13:01:03 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:04 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1073741824" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:04 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 Sep 02 13:01:04 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:04 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Attempting download of 9623d5da-1493-4679-9f94-35a469e47a44 ((None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}])) to volume cca09e38-11bb-47dd-8a27-84f52184a053. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[22abfedb-dc39-4fe5-b950-3c33246565b1]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:04 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o Sep 02 13:01:04 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:05 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:05 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o Sep 02 13:01:05 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:05 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o" returned: 1 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9623d5da-1493-4679-9f94-35a469e47a44_b3ffwj_o' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8562a6-251b-4719-bfe2-25833742e71d]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:05 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:05 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:05 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:05 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD Sep 02 13:01:05 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:06 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] 9623d5da-1493-4679-9f94-35a469e47a44 was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:06 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 Sep 02 13:01:06 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:06 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9623d5da-1493-4679-9f94-35a469e47a44_lwucao6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:01:06 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 13:01:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:06 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1G Sep 02 13:01:06 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:07 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 1G" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Downloaded image 9623d5da-1493-4679-9f94-35a469e47a44 ((None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}])) to volume cca09e38-11bb-47dd-8a27-84f52184a053 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Temporary image 9623d5da-1493-4679-9f94-35a469e47a44 for user 6beea80322be43afbc4798c447612433 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Marking volume cca09e38-11bb-47dd-8a27-84f52184a053 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Copying metadata from image 9623d5da-1493-4679-9f94-35a469e47a44 to cca09e38-11bb-47dd-8a27-84f52184a053. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Creating volume glance metadata for volume cca09e38-11bb-47dd-8a27-84f52184a053 backed by image 9623d5da-1493-4679-9f94-35a469e47a44 with: {'image_id': '9623d5da-1493-4679-9f94-35a469e47a44', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '256e792b15d5e3d4e8839790fd395433', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fbaf90-200b-4079-b881-b7c86161406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca09e38-11bb-47dd-8a27-84f52184a053', 'volume_size': 1, 'image_id': '9623d5da-1493-4679-9f94-35a469e47a44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9623d5da-1493-4679-9f94-35a469e47a44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '256e792b15d5e3d4e8839790fd395433', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4a5e3d610ce4721bbaca7499d4ed1fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6a70b0a044e1523837936b75147f4941ec240c009617682f1fc8306b92e814da0b7c1ac9159171225d7e3c680551e071912ff0dc6b904eaa7a297a5ff5024dc', 'id': '9623d5da-1493-4679-9f94-35a469e47a44', 'created_at': datetime.datetime(2026, 9, 2, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 1, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9623d5da-1493-4679-9f94-35a469e47a44/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a7395e-ccb8-4f0f-8cce-fac49ad976b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Volume volume-cca09e38-11bb-47dd-8a27-84f52184a053 (cca09e38-11bb-47dd-8a27-84f52184a053): created successfully Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a7395e-ccb8-4f0f-8cce-fac49ad976b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Flow 'volume_create_manager' (7ca33af9-671c-444d-a56f-83fdea5342d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8d8d874f-2fee-4595-be54-c37bc480c101 tempest-VolumeImageDependencyTests-1875255406 None] Created volume successfully. Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Acquiring lock "cinder-cca09e38-11bb-47dd-8a27-84f52184a053-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "cinder-cca09e38-11bb-47dd-8a27-84f52184a053-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Acquiring lock "cinder-quobyte-cca09e38-11bb-47dd-8a27-84f52184a053" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "cinder-quobyte-cca09e38-11bb-47dd-8a27-84f52184a053" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fcfb81-7060-47d6-9164-c4f84e5b846e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:08 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 Sep 02 13:01:08 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:08 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:08 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053 Sep 02 13:01:08 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:09 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cca09e38-11bb-47dd-8a27-84f52184a053" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "cinder-quobyte-cca09e38-11bb-47dd-8a27-84f52184a053" released by "delete_volume" :: held 0.707s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Created reservations ['5cd55578-0a61-4b90-b21c-f7d173c14046', '407bb5f4-a29f-4256-8b7a-f22d17c96dc2', 'b7c1cab2-61e6-4096-967f-9b3413c7ff39', '14e3318b-b8ce-4ef8-88fc-2ef66b12f4f2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:09 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:01:09 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:09 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:01:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Deleted volume successfully. Sep 02 13:01:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a0479633-f0c1-423f-90f5-b93458302f63 tempest-VolumeImageDependencyTests-1875255406 None] Lock "cinder-cca09e38-11bb-47dd-8a27-84f52184a053-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Flow 'volume_create_manager' (93a6196f-2775-4d52-8291-0995e5d0f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed1d408-0bdb-4407-bee5-9b57e64d42a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed1d408-0bdb-4407-bee5-9b57e64d42a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc62964-beb2-43b6-b1ef-216256bec987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4f651574f04e13add39aee3b507a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:14Z,use_quota=True,user_id='ae570171432149f3851fc6cedbbc9c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2ca2b-0844-4c5f-906f-8d615fcac93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2ca2b-0844-4c5f-906f-8d615fcac93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b963f200-ffc6-432e-9c12-57ad204ecf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b963f200-ffc6-432e-9c12-57ad204ecf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc62964-beb2-43b6-b1ef-216256bec987', 'volume_name': 'volume-2fc62964-beb2-43b6-b1ef-216256bec987', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594f731b-75fa-49bb-bd3f-6c725fcdcd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594f731b-75fa-49bb-bd3f-6c725fcdcd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8fa1b1-a884-4284-a3dc-426ea667f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:14 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Volume 2fc62964-beb2-43b6-b1ef-216256bec987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc62964-beb2-43b6-b1ef-216256bec987', 'volume_size': 1} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc62964-beb2-43b6-b1ef-216256bec987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4f651574f04e13add39aee3b507a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:14Z,use_quota=True,user_id='ae570171432149f3851fc6cedbbc9c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Creating volume 2fc62964-beb2-43b6-b1ef-216256bec987 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:01:14 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:14 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 1073741824 Sep 02 13:01:14 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:14 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 1073741824" returned: 0 in 0.544s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:14 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 Sep 02 13:01:14 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:14 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8fa1b1-a884-4284-a3dc-426ea667f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc62964-beb2-43b6-b1ef-216256bec987', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e721e67-b2c4-4a49-bf85-cfb58f746da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Volume volume-2fc62964-beb2-43b6-b1ef-216256bec987 (2fc62964-beb2-43b6-b1ef-216256bec987): created successfully Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e721e67-b2c4-4a49-bf85-cfb58f746da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Flow 'volume_create_manager' (93a6196f-2775-4d52-8291-0995e5d0f18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b2afc739-51db-4bc2-86e7-8eceb8f2e029 tempest-CinderUnicodeTest-1305152488 None] Created volume successfully. Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Flow 'volume_create_manager' (f0dc3221-d99b-4d2e-b531-18eeb6688c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf1c4e-8ef9-4eb3-bee7-8e39429ae92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf1c4e-8ef9-4eb3-bee7-8e39429ae92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1722422490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86be4862-d6ec-45bd-8431-c7a33851c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4f651574f04e13add39aee3b507a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:17Z,use_quota=True,user_id='ae570171432149f3851fc6cedbbc9c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d14fade-f53f-4707-bcd4-247bfdadd5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d14fade-f53f-4707-bcd4-247bfdadd5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce1f00-6d47-426b-911a-0de8615861d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce1f00-6d47-426b-911a-0de8615861d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86be4862-d6ec-45bd-8431-c7a33851c59e', 'volume_name': 'volume-86be4862-d6ec-45bd-8431-c7a33851c59e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733abde2-7753-423e-aabf-ec2c1f8f23db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733abde2-7753-423e-aabf-ec2c1f8f23db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6ad1b8-7cc7-416e-bcab-7f2f9268d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Volume 86be4862-d6ec-45bd-8431-c7a33851c59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86be4862-d6ec-45bd-8431-c7a33851c59e', 'volume_size': 1} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1722422490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86be4862-d6ec-45bd-8431-c7a33851c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4f651574f04e13add39aee3b507a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:17Z,use_quota=True,user_id='ae570171432149f3851fc6cedbbc9c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Creating volume 86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:01:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:01:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:16 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e 1073741824 Sep 02 13:01:16 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:17 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e 1073741824" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:17 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e Sep 02 13:01:17 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:17 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6ad1b8-7cc7-416e-bcab-7f2f9268d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86be4862-d6ec-45bd-8431-c7a33851c59e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716aa92d-918b-4edb-a76b-1b264e3e02b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Volume volume-86be4862-d6ec-45bd-8431-c7a33851c59e (86be4862-d6ec-45bd-8431-c7a33851c59e): created successfully Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716aa92d-918b-4edb-a76b-1b264e3e02b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Flow 'volume_create_manager' (f0dc3221-d99b-4d2e-b531-18eeb6688c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fa878ace-fde7-4398-9095-638ed06f53a0 tempest-CinderUnicodeTest-1305152488 None] Created volume successfully. Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Creating offline snapshot 312077fc-88b6-4117-885e-c0d0b68e183d of volume 86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[85af8241-bc95-4ea3-8ac5-3fad2fb6db7b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:18 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e Sep 02 13:01:18 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:18 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:18 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d 1G Sep 02 13:01:18 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:18 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d 1G" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be4862-d6ec-45bd-8431-c7a33851c59e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:18 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be4862-d6ec-45bd-8431-c7a33851c59e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d Sep 02 13:01:18 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:19 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be4862-d6ec-45bd-8431-c7a33851c59e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:19 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d is being set with open permissions: ugo+rw Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:19 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d Sep 02 13:01:19 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:19 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:19 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info Sep 02 13:01:19 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:19 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:19 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info is being set with open permissions: ugo+rw Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:19 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info Sep 02 13:01:19 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:19 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.info" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0f83b8c8-a60d-4c5b-995b-2a087abe7da0 tempest-CinderUnicodeTest-1305152488 None] Create snapshot completed successfully Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-312077fc-88b6-4117-885e-c0d0b68e183d-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-312077fc-88b6-4117-885e-c0d0b68e183d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-quobyte-312077fc-88b6-4117-885e-c0d0b68e183d" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-312077fc-88b6-4117-885e-c0d0b68e183d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Deleting offline snapshot 312077fc-88b6-4117-885e-c0d0b68e183d of volume 86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] snapshot_file for this snap is: volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5815c0c-db24-4108-92b9-c5bbb7ad7a67]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:20 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d Sep 02 13:01:20 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:20 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86be4862-d6ec-45bd-8431-c7a33851c59e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf160dd-c414-4258-a199-97aaab455b82]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:20 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e Sep 02 13:01:20 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:20 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:21 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d Sep 02 13:01:21 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:21 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:21 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d Sep 02 13:01:21 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:21 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e.312077fc-88b6-4117-885e-c0d0b68e183d" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-312077fc-88b6-4117-885e-c0d0b68e183d" released by "_delete_snapshot" :: held 1.551s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" released by "delete_snapshot" :: held 1.579s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Created reservations ['f6e63ebf-7bea-49f7-80ee-8df1a92e32bb', 'a8f0dfd3-b1b8-48d9-8c21-82d628409c0a', 'e6f2cb5b-22ec-46de-8435-8cd6d1c59135', '9f21940e-09a8-4cf1-b0cf-8f50647b3314'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:01:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Delete snapshot completed successfully. Sep 02 13:01:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7deff81-f654-419f-b3cf-48a014da61ab tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-312077fc-88b6-4117-885e-c0d0b68e183d-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-86be4862-d6ec-45bd-8431-c7a33851c59e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-86be4862-d6ec-45bd-8431-c7a33851c59e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4db6d0-9636-4c6a-afcf-8d1c5fea3d12]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:22 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e Sep 02 13:01:22 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:22 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:22 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e Sep 02 13:01:22 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:22 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-86be4862-d6ec-45bd-8431-c7a33851c59e" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-86be4862-d6ec-45bd-8431-c7a33851c59e" released by "delete_volume" :: held 0.695s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Created reservations ['145bd05d-6ed1-473d-bd7f-f6940f063373', '245090ab-9894-4049-8b17-e105639e3ea3', '98fc264f-f1e7-4eb6-82ea-b7283a17f7c9', '9760a479-f7e6-4e6c-9e93-d0cc24ab3198'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:23 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:01:23 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-2fc62964-beb2-43b6-b1ef-216256bec987-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:23 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:01:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Deleted volume successfully. Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-2fc62964-beb2-43b6-b1ef-216256bec987-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7c09d24f-e066-4b9f-8987-27c3f6670fcc tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-86be4862-d6ec-45bd-8431-c7a33851c59e-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "cinder-quobyte-2fc62964-beb2-43b6-b1ef-216256bec987" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-2fc62964-beb2-43b6-b1ef-216256bec987" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e8777-e4fd-4ef8-8b43-8dd61c05a4c9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:23 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 Sep 02 13:01:23 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:23 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:23 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987 Sep 02 13:01:23 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:24 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2fc62964-beb2-43b6-b1ef-216256bec987" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-quobyte-2fc62964-beb2-43b6-b1ef-216256bec987" released by "delete_volume" :: held 0.688s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Created reservations ['2ec2198a-7a00-4da1-a538-95acf88a9795', 'b0250cec-455c-40d1-abc2-ffe61a073971', 'a0f0445b-d733-4856-ac35-37fdaf998911', '18ad3699-1051-4de0-8e13-1aaaf4d9a5b3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:24 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:01:24 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:24 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:01:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Deleted volume successfully. Sep 02 13:01:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-647d03ab-7f43-495f-9088-707808741883 tempest-CinderUnicodeTest-1305152488 None] Lock "cinder-2fc62964-beb2-43b6-b1ef-216256bec987-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Flow 'volume_create_manager' (f371ff8a-5184-4410-a1f7-ffbb025c1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b77357-e347-4fc1-9bb6-9758cc4c42cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b77357-e347-4fc1-9bb6-9758cc4c42cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1508621873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5288ec-341e-4bf4-8d7e-d483f1559b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4424916e9d534f628862b8d4c15f5e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:28Z,use_quota=True,user_id='dcc988a5eeaa48a39effb77c96390fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013765d0-7ad5-470c-b336-8d4f5800a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013765d0-7ad5-470c-b336-8d4f5800a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e26cf2-0996-4e15-81f7-0808158ed6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e26cf2-0996-4e15-81f7-0808158ed6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5288ec-341e-4bf4-8d7e-d483f1559b17', 'volume_name': 'volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc34b60a-5fb6-4dc5-8aa8-5c2bf8c9940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc34b60a-5fb6-4dc5-8aa8-5c2bf8c9940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9940d7e6-683b-4900-a50f-296647b34f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Volume dc5288ec-341e-4bf4-8d7e-d483f1559b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17', 'volume_size': 1} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1508621873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5288ec-341e-4bf4-8d7e-d483f1559b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4424916e9d534f628862b8d4c15f5e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:01:28Z,use_quota=True,user_id='dcc988a5eeaa48a39effb77c96390fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Creating volume dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:01:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:01:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:28 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 1073741824 Sep 02 13:01:28 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:29 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 1073741824" returned: 0 in 0.511s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:29 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:01:29 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:29 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9940d7e6-683b-4900-a50f-296647b34f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe737934-56ef-4557-94f7-cd9616b3d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:01:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Volume volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 (dc5288ec-341e-4bf4-8d7e-d483f1559b17): created successfully Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe737934-56ef-4557-94f7-cd9616b3d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:01:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Flow 'volume_create_manager' (f371ff8a-5184-4410-a1f7-ffbb025c1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:01:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f10a8d27-e5fd-4a57-8895-f3e750df0a83 tempest-TestStampPattern-1682550446 None] Created volume successfully. Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:01:37 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:01:37 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:01:37 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:01:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:01:39 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=70,cinder:SELECT=43,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:01:39 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=55,cinder:UPDATE=52,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:01:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:01:50 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:01:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-6c1d476f-3ff7-4d14-a92f-4d16d95ffc67 req-2df6c764-a6ac-4472-a1bb-0b8b998b1e73 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:01:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-6c1d476f-3ff7-4d14-a92f-4d16d95ffc67 req-2df6c764-a6ac-4472-a1bb-0b8b998b1e73 tempest-TestStampPattern-1682550446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:01:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-6c1d476f-3ff7-4d14-a92f-4d16d95ffc67 req-2df6c764-a6ac-4472-a1bb-0b8b998b1e73 tempest-TestStampPattern-1682550446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:01:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-6c1d476f-3ff7-4d14-a92f-4d16d95ffc67 req-2df6c764-a6ac-4472-a1bb-0b8b998b1e73 tempest-TestStampPattern-1682550446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d666fa5-f6cb-4a76-b828-1f3736eec339', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 13:01:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-6c1d476f-3ff7-4d14-a92f-4d16d95ffc67 req-2df6c764-a6ac-4472-a1bb-0b8b998b1e73 tempest-TestStampPattern-1682550446 None] attachment_update completed successfully. Sep 02 13:02:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-b3427834-beac-4cd6-9fca-c21b952cf87f req-bb43b232-8b37-4611-8b50-a6424bf11607 tempest-TestStampPattern-1682550446 None] Terminate volume connection completed successfully. Sep 02 13:02:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-b3427834-beac-4cd6-9fca-c21b952cf87f req-bb43b232-8b37-4611-8b50-a6424bf11607 tempest-TestStampPattern-1682550446 None] Deleting attachment 9d666fa5-f6cb-4a76-b828-1f3736eec339. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 13:02:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Creating offline snapshot 207f0703-a411-42cf-bf09-aab204b73661 of volume dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:02:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5a0bc-f811-4ed4-85ae-26740705d93b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:04 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:02:04 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:04 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:04 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 1G Sep 02 13:02:04 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:04 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 1G" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:04 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:04 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:05 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.324s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 is being set with open permissions: ugo+rw Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:05 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:05 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:05 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:05 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info Sep 02 13:02:05 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:05 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info is being set with open permissions: ugo+rw Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:05 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info Sep 02 13:02:05 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:05 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.info" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2132ce66-40fa-4621-8ae3-62c9b973a181 tempest-TestStampPattern-1682550446 None] Create snapshot completed successfully Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Flow 'volume_create_manager' (ecca51a2-9c94-4b60-8f5e-dfdba0fb739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed1949f-d673-46ad-896f-44419ee87145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed1949f-d673-46ad-896f-44419ee87145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-879512042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379326c1-bbfa-4550-8dd9-f7bfe96cf097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4424916e9d534f628862b8d4c15f5e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=207f0703-a411-42cf-bf09-aab204b73661,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:02:13Z,use_quota=True,user_id='dcc988a5eeaa48a39effb77c96390fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e403b0-3b05-4a24-951d-583bec77f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e403b0-3b05-4a24-951d-583bec77f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519480a6-1e0c-49df-8ed1-9d2da9ef558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519480a6-1e0c-49df-8ed1-9d2da9ef558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '379326c1-bbfa-4550-8dd9-f7bfe96cf097', 'volume_name': 'volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097', 'volume_size': 1, 'snapshot_id': '207f0703-a411-42cf-bf09-aab204b73661'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea34dad9-1af1-45a5-a307-bc00bbf201d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea34dad9-1af1-45a5-a307-bc00bbf201d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4713f59-5091-4181-af28-f64dcff06742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Volume 379326c1-bbfa-4550-8dd9-f7bfe96cf097: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097', 'volume_size': 1, 'snapshot_id': '207f0703-a411-42cf-bf09-aab204b73661'} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661-379326c1-bbfa-4550-8dd9-f7bfe96cf097" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661-379326c1-bbfa-4550-8dd9-f7bfe96cf097" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Creating volume 379326c1-bbfa-4550-8dd9-f7bfe96cf097 from snapshot 207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] snapshot: 207f0703-a411-42cf-bf09-aab204b73661, volume: 379326c1-bbfa-4550-8dd9-f7bfe96cf097, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d8b33-eeaa-4bc4-85e3-8d2c8acc518c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:12 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:12 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:13 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da81aa-49c1-497e-b778-6a5fcde9440e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:13 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:02:13 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:13 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 13:02:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:13 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 Sep 02 13:02:13 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:19 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097" returned: 0 in 6.146s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:19 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:02:19 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Converted 1024.00 MB image at 166.54 MB/s Sep 02 13:02:19 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 is being set with open permissions: ugo+rw Sep 02 13:02:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:19 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 Sep 02 13:02:19 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:20 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" released by "_copy_volume_from_snapshot" :: held 7.325s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661-379326c1-bbfa-4550-8dd9-f7bfe96cf097" released by "_create_volume_from_snapshot" :: held 7.403s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.424s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4713f59-5091-4181-af28-f64dcff06742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097', 'volume_size': 1, 'snapshot_id': '207f0703-a411-42cf-bf09-aab204b73661'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa16bf66-55bb-4aa8-b1f4-63af53bf9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:02:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Volume volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 (379326c1-bbfa-4550-8dd9-f7bfe96cf097): created successfully Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa16bf66-55bb-4aa8-b1f4-63af53bf9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:02:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Flow 'volume_create_manager' (ecca51a2-9c94-4b60-8f5e-dfdba0fb739a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:02:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff0400b9-74ef-4cf0-87c0-28d76e922450 tempest-TestStampPattern-1682550446 None] Created volume successfully. Sep 02 13:02:30 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:02:30 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:37 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:02:37 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:37 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:02:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:02:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1f894789-d1aa-413f-8adc-c115863e1441 req-6b285ea8-286b-41ae-b93f-44b5b856bf8f tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1f894789-d1aa-413f-8adc-c115863e1441 req-6b285ea8-286b-41ae-b93f-44b5b856bf8f tempest-TestStampPattern-1682550446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1f894789-d1aa-413f-8adc-c115863e1441 req-6b285ea8-286b-41ae-b93f-44b5b856bf8f tempest-TestStampPattern-1682550446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-1f894789-d1aa-413f-8adc-c115863e1441 req-6b285ea8-286b-41ae-b93f-44b5b856bf8f tempest-TestStampPattern-1682550446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88', 'name': 'volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00a32494-3e34-44a6-88c3-b7d1a4d43bfd', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 13:02:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1f894789-d1aa-413f-8adc-c115863e1441 req-6b285ea8-286b-41ae-b93f-44b5b856bf8f tempest-TestStampPattern-1682550446 None] attachment_update completed successfully. Sep 02 13:02:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-6a2b6268-ab91-42da-a475-09317dceea16 req-af356bd6-66e7-4359-84a5-3f7fe50eb538 tempest-TestStampPattern-1682550446 None] Terminate volume connection completed successfully. Sep 02 13:02:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-6a2b6268-ab91-42da-a475-09317dceea16 req-af356bd6-66e7-4359-84a5-3f7fe50eb538 tempest-TestStampPattern-1682550446 None] Deleting attachment 00a32494-3e34-44a6-88c3-b7d1a4d43bfd. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-379326c1-bbfa-4550-8dd9-f7bfe96cf097-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "cinder-379326c1-bbfa-4550-8dd9-f7bfe96cf097-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ea0b1-21c8-41f5-8507-77785e871c74]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:55 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 Sep 02 13:02:55 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:55 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:55 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097 Sep 02 13:02:55 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:55 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-379326c1-bbfa-4550-8dd9-f7bfe96cf097" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-379326c1-bbfa-4550-8dd9-f7bfe96cf097" released by "delete_volume" :: held 0.655s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Created reservations ['920766e2-111a-4f42-8ac7-8f899dbe01c2', 'ab4167cb-f553-46c8-8a96-a8df6cda9590', '68868017-ee4f-4830-abe4-5019e3c951f5', '9ac90729-a849-40e5-95c7-d6074ef9aece'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:56 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:02:56 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:56 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:02:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Deleted volume successfully. Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0558e065-0dbe-421f-b449-f33be7486fde tempest-TestStampPattern-1682550446 None] Lock "cinder-379326c1-bbfa-4550-8dd9-f7bfe96cf097-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-207f0703-a411-42cf-bf09-aab204b73661-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-207f0703-a411-42cf-bf09-aab204b73661-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Deleting offline snapshot 207f0703-a411-42cf-bf09-aab204b73661 of volume dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] snapshot_file for this snap is: volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d896b641-a569-4a81-97cc-2eea3851cd83]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:56 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:56 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:57 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed1a11-49e3-4907-9e51-e7305dea5b01]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:57 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:02:57 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:57 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:57 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:57 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:57 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:02:57 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661 Sep 02 13:02:57 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:02:58 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 02 13:02:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17.207f0703-a411-42cf-bf09-aab204b73661" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:02:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-207f0703-a411-42cf-bf09-aab204b73661" released by "_delete_snapshot" :: held 1.519s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" released by "delete_snapshot" :: held 1.540s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:02:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Created reservations ['b711ae0d-62d7-4a8c-9697-ee3e169a1d0b', 'e7ff1b2a-6d02-4d35-aca9-fc1354125af7', 'bc62b55d-fccc-4b05-9771-0da98b6fe015', '60bed23c-86c8-428c-a711-8f4d72ba7b80'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:02:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Delete snapshot completed successfully. Sep 02 13:02:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-820ceeca-872a-4f3f-93e5-a76d5baacadf tempest-TestStampPattern-1682550446 None] Lock "cinder-207f0703-a411-42cf-bf09-aab204b73661-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-dc5288ec-341e-4bf4-8d7e-d483f1559b17-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "cinder-dc5288ec-341e-4bf4-8d7e-d483f1559b17-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Acquiring lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a633ab-9d5c-4ae4-8543-4501d23620dd]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:02 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:03:02 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:02 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:02 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17 Sep 02 13:03:02 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:02 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-dc5288ec-341e-4bf4-8d7e-d483f1559b17" returned: 0 in 0.236s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "cinder-quobyte-dc5288ec-341e-4bf4-8d7e-d483f1559b17" released by "delete_volume" :: held 0.649s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Created reservations ['2b3e58f1-f911-4246-a14f-6344463ab63f', 'b398f420-2665-4ba6-8b5c-4c5717cff29f', 'be9d5630-2cbb-42df-9890-7cadae4b7b99', '0e5837f6-dc1f-44a4-a4ae-a5b3c2ac2340'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:03 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:03 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:03 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Deleted volume successfully. Sep 02 13:03:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3b150e13-22d7-4dce-aa33-0c100e0926b7 tempest-TestStampPattern-1682550446 None] Lock "cinder-dc5288ec-341e-4bf4-8d7e-d483f1559b17-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:03:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (9722af9a-45da-4a48-bcca-d8d1929939a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ebb55e-2448-416f-97c0-57933f651c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ebb55e-2448-416f-97c0-57933f651c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828145210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9ffad0-5151-471f-9a6b-550648c72cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:15Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6a4139-b145-4fdc-ac57-073f4862cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6a4139-b145-4fdc-ac57-073f4862cae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba7b20-009d-4c5f-b14f-ef2ecb57c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ba7b20-009d-4c5f-b14f-ef2ecb57c010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9ffad0-5151-471f-9a6b-550648c72cac', 'volume_name': 'volume-ed9ffad0-5151-471f-9a6b-550648c72cac', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eec9eeb-327d-40d1-90c8-cc98f589e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eec9eeb-327d-40d1-90c8-cc98f589e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad3b670-e682-4b48-8f0f-d184aed1cc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:14 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume ed9ffad0-5151-471f-9a6b-550648c72cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9ffad0-5151-471f-9a6b-550648c72cac', 'volume_size': 1} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828145210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9ffad0-5151-471f-9a6b-550648c72cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:15Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:14 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:14 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac 1073741824 Sep 02 13:03:14 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:15 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac 1073741824" returned: 0 in 0.443s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:15 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac Sep 02 13:03:15 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:15 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad3b670-e682-4b48-8f0f-d184aed1cc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9ffad0-5151-471f-9a6b-550648c72cac', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c45178-cf02-4de3-b3b5-ef129fd28e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-ed9ffad0-5151-471f-9a6b-550648c72cac (ed9ffad0-5151-471f-9a6b-550648c72cac): created successfully Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c45178-cf02-4de3-b3b5-ef129fd28e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (9722af9a-45da-4a48-bcca-d8d1929939a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cc6e97e3-5964-4c5e-8831-df216b28da97 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating offline snapshot 1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 of volume ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49f65f-6d68-4387-b67a-9d0bfa3f0160]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:16 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac Sep 02 13:03:16 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:16 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac" returned: 0 in 0.367s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:16 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 1G Sep 02 13:03:16 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:16 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 1G" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ffad0-5151-471f-9a6b-550648c72cac -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:16 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ffad0-5151-471f-9a6b-550648c72cac -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 Sep 02 13:03:16 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:17 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ffad0-5151-471f-9a6b-550648c72cac -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:17 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 is being set with open permissions: ugo+rw Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:17 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 Sep 02 13:03:17 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:17 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:17 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info Sep 02 13:03:17 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:17 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:17 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info is being set with open permissions: ugo+rw Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:17 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info Sep 02 13:03:17 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:17 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.info" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21c92508-7609-410e-8f76-5c1e0b015e20 tempest-CreateVolumesFromSnapshotTest-597100084 None] Create snapshot completed successfully Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (a2849036-692e-4634-9055-c85dcec41966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571663dc-8a65-4a02-be55-f3d5f72249be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571663dc-8a65-4a02-be55-f3d5f72249be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639474044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639c8ee1-5180-4149-8e86-11c31374a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52496148-8747-488a-b134-42e14277386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52496148-8747-488a-b134-42e14277386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b7b11a-5ba5-41d8-a7f3-6c3581bfec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b7b11a-5ba5-41d8-a7f3-6c3581bfec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639c8ee1-5180-4149-8e86-11c31374a1da', 'volume_name': 'volume-639c8ee1-5180-4149-8e86-11c31374a1da', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf702d21-3ee7-4be9-b2ee-3cf2325a6670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf702d21-3ee7-4be9-b2ee-3cf2325a6670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d9bbef-2a30-4350-bd77-919d7e1fd289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume 639c8ee1-5180-4149-8e86-11c31374a1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639c8ee1-5180-4149-8e86-11c31374a1da', 'volume_size': 1} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639474044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639c8ee1-5180-4149-8e86-11c31374a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume 639c8ee1-5180-4149-8e86-11c31374a1da {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:18 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da 1073741824 Sep 02 13:03:18 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (51c59286-8243-4cbe-9a79-adf0d31e9fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85648458-2efd-4451-bd46-9e68465ea1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85648458-2efd-4451-bd46-9e68465ea1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1563634690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c7a82a-ff08-44be-ab0f-699efbb1e55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83979369-8dd0-4f37-be06-36c8a531ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83979369-8dd0-4f37-be06-36c8a531ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d77d4e-c64b-448f-81dc-831852764ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d77d4e-c64b-448f-81dc-831852764ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c7a82a-ff08-44be-ab0f-699efbb1e55a', 'volume_name': 'volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad7c31-6d26-4efd-85ad-9069b23d98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad7c31-6d26-4efd-85ad-9069b23d98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec3762d-e1a1-4d54-b74a-063170576b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume 29c7a82a-ff08-44be-ab0f-699efbb1e55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a', 'volume_size': 1} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:19 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da 1073741824" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:19 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da Sep 02 13:03:19 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (5073f69c-e566-4b76-bcf5-5bc279d871b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f12e69-600e-4c6a-b037-cdaaac44e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f12e69-600e-4c6a-b037-cdaaac44e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388987714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d4d51f-0942-4827-93b9-4083e7ba14ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93bc2a7-aa68-4fc8-ad8b-61452b12c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93bc2a7-aa68-4fc8-ad8b-61452b12c943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0c62d5-e048-4d84-b03b-49dad533078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0c62d5-e048-4d84-b03b-49dad533078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d4d51f-0942-4827-93b9-4083e7ba14ae', 'volume_name': 'volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2c24a0-5d8f-4d29-a46e-174a09acd2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2c24a0-5d8f-4d29-a46e-174a09acd2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2815212e-4bf1-4748-8384-b808c24f62a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume c9d4d51f-0942-4827-93b9-4083e7ba14ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae', 'volume_size': 1} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:19 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1563634690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c7a82a-ff08-44be-ab0f-699efbb1e55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume 29c7a82a-ff08-44be-ab0f-699efbb1e55a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:19 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a 1073741824 Sep 02 13:03:19 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d9bbef-2a30-4350-bd77-919d7e1fd289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639c8ee1-5180-4149-8e86-11c31374a1da', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46574fc5-736e-4ee7-a2bb-45fdfc1f1b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-639c8ee1-5180-4149-8e86-11c31374a1da (639c8ee1-5180-4149-8e86-11c31374a1da): created successfully Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46574fc5-736e-4ee7-a2bb-45fdfc1f1b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (a2849036-692e-4634-9055-c85dcec41966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-14959409-4196-4b33-bcf7-7f9e498b2b0e tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (e53c4e7f-d6f2-42bb-82b1-45e1ab60a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876c13b2-030b-40be-a858-5b82abc1c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876c13b2-030b-40be-a858-5b82abc1c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953482528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730d9848-1937-41ae-8703-a7e4bd2d0bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:20Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31344a35-c51d-4e5b-9208-8b8baa978dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31344a35-c51d-4e5b-9208-8b8baa978dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5554ed2f-9c9d-4c40-b5e1-156cb1b569d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5554ed2f-9c9d-4c40-b5e1-156cb1b569d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730d9848-1937-41ae-8703-a7e4bd2d0bd5', 'volume_name': 'volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c471db4b-bad2-4972-844b-36d3029a9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c471db4b-bad2-4972-844b-36d3029a9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf1a83c-0e65-4957-81b8-a60682058043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume 730d9848-1937-41ae-8703-a7e4bd2d0bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5', 'volume_size': 1} Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:19 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a 1073741824" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:20 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a Sep 02 13:03:20 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (60135c78-a338-431a-ad6f-39770331aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4206a71a-c9d9-41e6-bc2d-b05aaa3c9dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4206a71a-c9d9-41e6-bc2d-b05aaa3c9dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823306130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b834ba7-77ce-4f75-9aec-a1a641208020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:20Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66db66-4190-4ece-9b34-647ab2d0a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66db66-4190-4ece-9b34-647ab2d0a195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c93df7-b07a-4366-b0a0-65f52259dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c93df7-b07a-4366-b0a0-65f52259dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b834ba7-77ce-4f75-9aec-a1a641208020', 'volume_name': 'volume-1b834ba7-77ce-4f75-9aec-a1a641208020', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6160c796-a35c-49ac-b58e-48b2a63754f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6160c796-a35c-49ac-b58e-48b2a63754f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50b197d-39d1-4193-a68f-5e79818f16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume 1b834ba7-77ce-4f75-9aec-a1a641208020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b834ba7-77ce-4f75-9aec-a1a641208020', 'volume_size': 1} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:20 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388987714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d4d51f-0942-4827-93b9-4083e7ba14ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:19Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume c9d4d51f-0942-4827-93b9-4083e7ba14ae {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:20 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec3762d-e1a1-4d54-b74a-063170576b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae 1073741824 Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f765c-568d-4ba0-acac-de9ff1969281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:20 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a (29c7a82a-ff08-44be-ab0f-699efbb1e55a): created successfully Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f765c-568d-4ba0-acac-de9ff1969281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (51c59286-8243-4cbe-9a79-adf0d31e9fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-83e0d60e-7f16-4844-a06f-1bcf77f8e551 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:20 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae 1073741824" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:20 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae Sep 02 13:03:20 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:21 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953482528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730d9848-1937-41ae-8703-a7e4bd2d0bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:20Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume 730d9848-1937-41ae-8703-a7e4bd2d0bd5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2815212e-4bf1-4748-8384-b808c24f62a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08527bcb-b9c3-4064-82a0-9aac99cc5758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:21 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 1073741824 Sep 02 13:03:21 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae (c9d4d51f-0942-4827-93b9-4083e7ba14ae): created successfully Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08527bcb-b9c3-4064-82a0-9aac99cc5758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (5073f69c-e566-4b76-bcf5-5bc279d871b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef0933e1-9a67-4c8b-a889-1ba113a93e04 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:21 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 1073741824" returned: 0 in 0.454s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:21 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 Sep 02 13:03:21 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:21 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823306130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b834ba7-77ce-4f75-9aec-a1a641208020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0212962ec3d4c5caecb0b95af4636cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:20Z,use_quota=True,user_id='85c60fbf305e45758d492123e98d5a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Creating volume 1b834ba7-77ce-4f75-9aec-a1a641208020 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf1a83c-0e65-4957-81b8-a60682058043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:21 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 1073741824 Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166b1346-9a2d-4457-85dd-2524f6534b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:21 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 (730d9848-1937-41ae-8703-a7e4bd2d0bd5): created successfully Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166b1346-9a2d-4457-85dd-2524f6534b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (e53c4e7f-d6f2-42bb-82b1-45e1ab60a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-309c7f01-e3b2-4197-b38e-f06067a77faa tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:22 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 1073741824" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:22 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 Sep 02 13:03:22 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:22 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50b197d-39d1-4193-a68f-5e79818f16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b834ba7-77ce-4f75-9aec-a1a641208020', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c516e4b-37a3-4e7d-a88f-74a593d738df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Volume volume-1b834ba7-77ce-4f75-9aec-a1a641208020 (1b834ba7-77ce-4f75-9aec-a1a641208020): created successfully Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c516e4b-37a3-4e7d-a88f-74a593d738df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Flow 'volume_create_manager' (60135c78-a338-431a-ad6f-39770331aca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab6a5a79-ef36-41b8-9595-d277bd45b70a tempest-CreateVolumesFromSnapshotTest-597100084 None] Created volume successfully. Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-1b834ba7-77ce-4f75-9aec-a1a641208020-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-1b834ba7-77ce-4f75-9aec-a1a641208020-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-1b834ba7-77ce-4f75-9aec-a1a641208020" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-1b834ba7-77ce-4f75-9aec-a1a641208020" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c158f-86db-4d49-aa6a-0f392242d20a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:23 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 Sep 02 13:03:23 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:23 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:23 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020 Sep 02 13:03:23 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:24 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-1b834ba7-77ce-4f75-9aec-a1a641208020" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-1b834ba7-77ce-4f75-9aec-a1a641208020" released by "delete_volume" :: held 0.644s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['1f931a2b-dcd0-417b-b74c-8f0af0c51b82', '3f9ec28b-b7c5-4b11-80f4-2cce2cb11b7d', '70c0ee1a-cd13-414f-ae6a-3377b871d551', 'c3f28de4-d692-4c7c-9ebe-b9f8f1a58016'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:24 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:24 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:24 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c1d79fe-2a7a-48f6-9a0a-a7d3c68a9b43 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-1b834ba7-77ce-4f75-9aec-a1a641208020-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-730d9848-1937-41ae-8703-a7e4bd2d0bd5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-730d9848-1937-41ae-8703-a7e4bd2d0bd5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-730d9848-1937-41ae-8703-a7e4bd2d0bd5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-730d9848-1937-41ae-8703-a7e4bd2d0bd5" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f49054-21fa-42e9-88be-e42d074601c2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:24 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 Sep 02 13:03:24 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:25 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:25 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5 Sep 02 13:03:25 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:25 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-730d9848-1937-41ae-8703-a7e4bd2d0bd5" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-730d9848-1937-41ae-8703-a7e4bd2d0bd5" released by "delete_volume" :: held 0.657s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['c502c90b-3b5e-4699-83d6-3314a9581ac6', '887e4020-8e72-4fca-b505-00dcedd69b44', '6b435738-683a-487a-87f2-a3972cb9e783', '12334797-5732-45d3-b1a2-bc505739e7a2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:25 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:25 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:25 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eb29d1d5-0b65-44a0-8b29-8c768b75cd9a tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-730d9848-1937-41ae-8703-a7e4bd2d0bd5-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-c9d4d51f-0942-4827-93b9-4083e7ba14ae-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-c9d4d51f-0942-4827-93b9-4083e7ba14ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-c9d4d51f-0942-4827-93b9-4083e7ba14ae" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-c9d4d51f-0942-4827-93b9-4083e7ba14ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9acf1-9991-4925-a80e-c453a0ec65eb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:25 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae Sep 02 13:03:26 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:26 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:26 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae Sep 02 13:03:26 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:26 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c9d4d51f-0942-4827-93b9-4083e7ba14ae" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-c9d4d51f-0942-4827-93b9-4083e7ba14ae" released by "delete_volume" :: held 0.647s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['a5ad3bbe-7f2b-464b-8ccc-6b00c5f65468', 'bbb24020-4249-439b-b3b2-a8c96695ced0', 'e984f8d6-6cb4-411f-b6e8-3a933c85757f', '00e61fd6-1f4c-4a82-97d1-8ff7a1b8a1b7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:26 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:26 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:26 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b72b050-4498-4745-9746-45d5863ae739 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-c9d4d51f-0942-4827-93b9-4083e7ba14ae-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-29c7a82a-ff08-44be-ab0f-699efbb1e55a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-29c7a82a-ff08-44be-ab0f-699efbb1e55a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-29c7a82a-ff08-44be-ab0f-699efbb1e55a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-29c7a82a-ff08-44be-ab0f-699efbb1e55a" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b410977-9f24-4e7e-bdca-13e686fcdd08]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:27 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a Sep 02 13:03:27 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:27 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:27 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a Sep 02 13:03:27 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:27 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-29c7a82a-ff08-44be-ab0f-699efbb1e55a" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-29c7a82a-ff08-44be-ab0f-699efbb1e55a" released by "delete_volume" :: held 0.636s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['771956ea-81e2-4e88-98ed-f41ce3045825', '4884215a-9957-4207-942a-c78edbe80ae7', 'b658ba7c-7db9-4e90-83d5-ef0ba611207c', 'abb08701-ef58-423d-ad83-36011c33deb6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:27 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:27 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:28 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-982b4cf7-f3a5-424f-8ea4-f2d06acbc88f tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-29c7a82a-ff08-44be-ab0f-699efbb1e55a-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-639c8ee1-5180-4149-8e86-11c31374a1da-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-639c8ee1-5180-4149-8e86-11c31374a1da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-639c8ee1-5180-4149-8e86-11c31374a1da" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-639c8ee1-5180-4149-8e86-11c31374a1da" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6015440f-c67c-463f-93cf-53378c970482]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:28 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da Sep 02 13:03:28 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:28 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:28 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da Sep 02 13:03:28 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:28 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-639c8ee1-5180-4149-8e86-11c31374a1da" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-639c8ee1-5180-4149-8e86-11c31374a1da" released by "delete_volume" :: held 0.646s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['a954a845-3110-45b1-9695-4bea367b8d50', '04e1f1bf-734a-4f1c-9f52-03118942565e', 'cc00ccfb-e7d4-45d8-85c8-0b509f8c329c', 'c4ffc85c-4905-4fde-affd-70a12c76ffcd'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:28 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:28 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:29 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-dec43ec6-67ee-4882-9fe2-17db2576a93d tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-639c8ee1-5180-4149-8e86-11c31374a1da-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleting offline snapshot 1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 of volume ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] snapshot_file for this snap is: volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd62128-41bc-4811-9a4d-e248a3aa8537]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:29 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 Sep 02 13:03:29 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:29 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed9ffad0-5151-471f-9a6b-550648c72cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a23536b-195e-4952-9c04-a607977d7475]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:29 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac Sep 02 13:03:29 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:30 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:30 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 Sep 02 13:03:30 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:30 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:30 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59 Sep 02 13:03:30 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:30 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac.1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59" released by "_delete_snapshot" :: held 1.405s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" released by "delete_snapshot" :: held 1.427s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['4f67560b-4263-48d8-9021-9b633313b548', '0e033306-a8e7-4bfc-9894-4cd5f7e617f5', 'e73d0f62-18ec-45ee-b489-c3cde58f8620', '45b3407b-b8e3-473c-96f0-fce4f904f8d4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Delete snapshot completed successfully. Sep 02 13:03:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01196fbb-b58a-4836-b045-ff05fa0979c8 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-1ff9ee23-0f5b-4a46-8ebd-3e066dab5c59-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-ed9ffad0-5151-471f-9a6b-550648c72cac-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-ed9ffad0-5151-471f-9a6b-550648c72cac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa0d5e2-5dcf-4e06-81f9-c2661681c34b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:31 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac Sep 02 13:03:31 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:31 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:31 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac Sep 02 13:03:31 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:32 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ed9ffad0-5151-471f-9a6b-550648c72cac" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-quobyte-ed9ffad0-5151-471f-9a6b-550648c72cac" released by "delete_volume" :: held 0.657s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Created reservations ['3ef50f40-a898-4ada-bddc-0411637be4a5', '5c5334d9-edb0-4233-bfbe-2a381e1d23bb', '613f2071-05a8-443d-b177-e809f9cab523', '8ee09161-ce4e-4fcc-807a-1e69012b6de9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:32 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:32 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:32 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Deleted volume successfully. Sep 02 13:03:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d9712c4-2f9a-43e2-987c-e739d2712b42 tempest-CreateVolumesFromSnapshotTest-597100084 None] Lock "cinder-ed9ffad0-5151-471f-9a6b-550648c72cac-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (9c5d6677-32a5-4f47-8237-12d157c3b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb622d0-46ae-496e-938a-0c2cbac8f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb622d0-46ae-496e-938a-0c2cbac8f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041647411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9c39cf-a157-4075-9e4c-563c4727c24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:35Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea280e1d-591c-4b95-b1c6-bfa2874c51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea280e1d-591c-4b95-b1c6-bfa2874c51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f470c77-b197-4ea2-a77f-ef6f58f19e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f470c77-b197-4ea2-a77f-ef6f58f19e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9c39cf-a157-4075-9e4c-563c4727c24d', 'volume_name': 'volume-4b9c39cf-a157-4075-9e4c-563c4727c24d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f4de0b-cdc5-4fc9-810a-fbcbcf2aac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f4de0b-cdc5-4fc9-810a-fbcbcf2aac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e303d0e3-ed7a-4570-8249-540b9436f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume 4b9c39cf-a157-4075-9e4c-563c4727c24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9c39cf-a157-4075-9e4c-563c4727c24d', 'volume_size': 1} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041647411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9c39cf-a157-4075-9e4c-563c4727c24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:35Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume 4b9c39cf-a157-4075-9e4c-563c4727c24d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:35 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:35 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d 1073741824 Sep 02 13:03:35 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:35 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d 1073741824" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:35 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d Sep 02 13:03:35 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:36 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e303d0e3-ed7a-4570-8249-540b9436f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9c39cf-a157-4075-9e4c-563c4727c24d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86492be-0212-47eb-9bef-ef3cce3e0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-4b9c39cf-a157-4075-9e4c-563c4727c24d (4b9c39cf-a157-4075-9e4c-563c4727c24d): created successfully Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86492be-0212-47eb-9bef-ef3cce3e0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (9c5d6677-32a5-4f47-8237-12d157c3b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e483526b-4250-486e-acc5-80e69abd760f tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (fa5f6197-9f3b-4dc7-b411-91de055f0efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5532dfc8-a8e8-4b47-990b-f5150636b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5532dfc8-a8e8-4b47-990b-f5150636b512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714953971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9031fc8a-a0ef-49b9-9327-9573489cd8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba61c13-20a1-46ba-9f40-b76020211f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba61c13-20a1-46ba-9f40-b76020211f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5850ea6-29fb-4024-a07c-7af24f623429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5850ea6-29fb-4024-a07c-7af24f623429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9031fc8a-a0ef-49b9-9327-9573489cd8c5', 'volume_name': 'volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596cac1e-9dae-4ec3-b304-28dd7d4f60f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596cac1e-9dae-4ec3-b304-28dd7d4f60f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3016726-a2df-4059-a216-3ba01f30eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume 9031fc8a-a0ef-49b9-9327-9573489cd8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5', 'volume_size': 1} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714953971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9031fc8a-a0ef-49b9-9327-9573489cd8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume 9031fc8a-a0ef-49b9-9327-9573489cd8c5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:36 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:36 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 1073741824 Sep 02 13:03:36 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (346c48d7-0f6d-487a-a57f-93f9fcc62921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ba911-a562-41b0-bb3e-657aff150529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ba911-a562-41b0-bb3e-657aff150529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094389194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c559f8-4cce-481f-82ef-73ee452dd7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d688a51-a6e6-4905-8eec-308e7e8d68e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d688a51-a6e6-4905-8eec-308e7e8d68e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daef8b11-9cfc-44b3-a547-84b0f51adc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daef8b11-9cfc-44b3-a547-84b0f51adc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c559f8-4cce-481f-82ef-73ee452dd7c0', 'volume_name': 'volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba07db7-a2f8-4289-8c3b-6a09aef6d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba07db7-a2f8-4289-8c3b-6a09aef6d91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639aba2b-eba2-4d6e-b3ea-c4920d58b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume a1c559f8-4cce-481f-82ef-73ee452dd7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0', 'volume_size': 1} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:37 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 1073741824" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:37 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 Sep 02 13:03:37 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:37 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:37 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (ca914355-c8af-402a-ab27-d405d96dab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119de88-7c92-4d3a-ac26-02e8ed06b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119de88-7c92-4d3a-ac26-02e8ed06b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1107579963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31562571-85d5-4f49-acd0-7a22738f91db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3543e20-fbbd-42fb-8f11-ee07de649ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3543e20-fbbd-42fb-8f11-ee07de649ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a5c853-fabf-4f2e-a250-4e2aeecd4055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a5c853-fabf-4f2e-a250-4e2aeecd4055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31562571-85d5-4f49-acd0-7a22738f91db', 'volume_name': 'volume-31562571-85d5-4f49-acd0-7a22738f91db', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad4977-40ff-496c-bc95-a7a444d5724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad4977-40ff-496c-bc95-a7a444d5724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286bb2c4-eaeb-4858-9d33-2c17d46fbf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume 31562571-85d5-4f49-acd0-7a22738f91db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31562571-85d5-4f49-acd0-7a22738f91db', 'volume_size': 1} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:37 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094389194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c559f8-4cce-481f-82ef-73ee452dd7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume a1c559f8-4cce-481f-82ef-73ee452dd7c0 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:37 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:37 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 1073741824 Sep 02 13:03:37 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3016726-a2df-4059-a216-3ba01f30eb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efad8f48-f043-434d-a957-ee1b7123ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 (9031fc8a-a0ef-49b9-9327-9573489cd8c5): created successfully Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efad8f48-f043-434d-a957-ee1b7123ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (fa5f6197-9f3b-4dc7-b411-91de055f0efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f5e975bb-6482-4f70-a364-b0e0d23af5d0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (4d0f4d88-c718-4101-a460-590f2593864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bfde5d-dcd3-41b7-8d08-662ef9c0e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bfde5d-dcd3-41b7-8d08-662ef9c0e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058436644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aa2fd0-fe7f-4b16-8173-ba75f934981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:38Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43ebaf-2b83-4a85-8f5a-22e051dbe6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43ebaf-2b83-4a85-8f5a-22e051dbe6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bfe87a-cce9-4df4-969a-055933fed78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bfe87a-cce9-4df4-969a-055933fed78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21aa2fd0-fe7f-4b16-8173-ba75f934981f', 'volume_name': 'volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b8d58-bf6e-441f-b2f5-4ce00725c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b8d58-bf6e-441f-b2f5-4ce00725c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50bfa5e-cb1e-46d1-8e84-dbac64fb0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume 21aa2fd0-fe7f-4b16-8173-ba75f934981f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f', 'volume_size': 1} Sep 02 13:03:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:38 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 1073741824" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (fb0bae58-9d52-49c1-a194-94edea030fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b0ed20-ee94-4c5d-8ce5-537c2e18b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b0ed20-ee94-4c5d-8ce5-537c2e18b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034604966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7902927-d236-443c-91d9-60ec49c87e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:38Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed3b89-726e-4264-8e52-52c054fd38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ed3b89-726e-4264-8e52-52c054fd38af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e1cb7e-5a0f-4812-bf41-e1a0efddf6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e1cb7e-5a0f-4812-bf41-e1a0efddf6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7902927-d236-443c-91d9-60ec49c87e95', 'volume_name': 'volume-b7902927-d236-443c-91d9-60ec49c87e95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d34c23-cb26-494a-9c94-6549e7835a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d34c23-cb26-494a-9c94-6549e7835a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f76a76-cc20-4fdc-abee-661aa303ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume b7902927-d236-443c-91d9-60ec49c87e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7902927-d236-443c-91d9-60ec49c87e95', 'volume_size': 1} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:38 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 Sep 02 13:03:38 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:38 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1107579963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31562571-85d5-4f49-acd0-7a22738f91db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:37Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume 31562571-85d5-4f49-acd0-7a22738f91db {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639aba2b-eba2-4d6e-b3ea-c4920d58b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db 1073741824 Sep 02 13:03:38 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74f2fae-c783-43ff-9806-e1911fe1f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 (a1c559f8-4cce-481f-82ef-73ee452dd7c0): created successfully Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74f2fae-c783-43ff-9806-e1911fe1f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (346c48d7-0f6d-487a-a57f-93f9fcc62921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c179ed4b-42c7-4041-9fd8-ec2f71f66dfc tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:39 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db 1073741824" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:39 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db Sep 02 13:03:39 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:39 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2058436644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aa2fd0-fe7f-4b16-8173-ba75f934981f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:38Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume 21aa2fd0-fe7f-4b16-8173-ba75f934981f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286bb2c4-eaeb-4858-9d33-2c17d46fbf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31562571-85d5-4f49-acd0-7a22738f91db', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:39 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f 1073741824 Sep 02 13:03:39 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b4ab07-b30a-4315-bab5-610c3933b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-31562571-85d5-4f49-acd0-7a22738f91db (31562571-85d5-4f49-acd0-7a22738f91db): created successfully Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b4ab07-b30a-4315-bab5-610c3933b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (ca914355-c8af-402a-ab27-d405d96dab2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d282ddd-c397-4e1a-ad3a-6481bdd8c5a0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:39 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f 1073741824" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:39 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f Sep 02 13:03:39 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:39 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f" returned: 0 in 0.234s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034604966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7902927-d236-443c-91d9-60ec49c87e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9bf2b4e584e80b6ca147a8f5971ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:03:38Z,use_quota=True,user_id='95c70782c09340568ee7f82e730a83d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Creating volume b7902927-d236-443c-91d9-60ec49c87e95 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:03:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:03:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50bfa5e-cb1e-46d1-8e84-dbac64fb0224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:40 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 1073741824 Sep 02 13:03:40 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cfb360-e0f5-4d61-906e-1568f56bcc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f (21aa2fd0-fe7f-4b16-8173-ba75f934981f): created successfully Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cfb360-e0f5-4d61-906e-1568f56bcc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (4d0f4d88-c718-4101-a460-590f2593864d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bc9abd82-89fa-4608-9597-c21c9539ffc6 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:40 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 1073741824" returned: 0 in 0.435s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:40 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 Sep 02 13:03:40 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:40 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f76a76-cc20-4fdc-abee-661aa303ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7902927-d236-443c-91d9-60ec49c87e95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a551d-1488-4b4e-ba1d-392e6bce2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:03:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Volume volume-b7902927-d236-443c-91d9-60ec49c87e95 (b7902927-d236-443c-91d9-60ec49c87e95): created successfully Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a551d-1488-4b4e-ba1d-392e6bce2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:03:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Flow 'volume_create_manager' (fb0bae58-9d52-49c1-a194-94edea030fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:03:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-be7b26d3-28d9-4669-85d3-9d3ae629ab39 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created volume successfully. Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-b7902927-d236-443c-91d9-60ec49c87e95-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-b7902927-d236-443c-91d9-60ec49c87e95-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-b7902927-d236-443c-91d9-60ec49c87e95" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-b7902927-d236-443c-91d9-60ec49c87e95" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[495cfd10-8bd6-4ef4-8674-8d222ca36e3a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:41 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 Sep 02 13:03:41 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:42 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:42 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95 Sep 02 13:03:42 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:42 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b7902927-d236-443c-91d9-60ec49c87e95" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-b7902927-d236-443c-91d9-60ec49c87e95" released by "delete_volume" :: held 0.648s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['024f0ef2-fe4e-410b-8941-053b25741096', 'fc46ef15-239b-427e-a2e5-b6836666b54e', '691415cb-8af5-43cd-9d79-ef32f7c7e954', '36b48154-96cc-4207-86f2-4815db1a71b4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:42 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:42 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:42 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60e5171a-98bf-4c2c-b896-a7f3f248e176 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-b7902927-d236-443c-91d9-60ec49c87e95-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-21aa2fd0-fe7f-4b16-8173-ba75f934981f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-21aa2fd0-fe7f-4b16-8173-ba75f934981f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-21aa2fd0-fe7f-4b16-8173-ba75f934981f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-21aa2fd0-fe7f-4b16-8173-ba75f934981f" acquired by "delete_volume" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df440b-17de-44f5-98a0-63306e0b9e8f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:42 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f Sep 02 13:03:42 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:43 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:43 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f Sep 02 13:03:43 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:43 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21aa2fd0-fe7f-4b16-8173-ba75f934981f" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-21aa2fd0-fe7f-4b16-8173-ba75f934981f" released by "delete_volume" :: held 0.625s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['d1622191-1a8e-4a68-a221-00d727463b03', '9345bbe2-9173-4a9b-a8c5-c68701b8c4b2', 'c4294ed1-f451-4d1d-b6a5-cf0a7a1621ab', 'ffb83c01-5458-4e33-b882-38e371fc8ba9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:43 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:43 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:43 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-49c113fa-6f34-481f-906d-a490b0bc1781 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-21aa2fd0-fe7f-4b16-8173-ba75f934981f-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-31562571-85d5-4f49-acd0-7a22738f91db-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-31562571-85d5-4f49-acd0-7a22738f91db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-31562571-85d5-4f49-acd0-7a22738f91db" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-31562571-85d5-4f49-acd0-7a22738f91db" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d13f5f-d695-4191-87b7-6b07a8c11076]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:44 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db Sep 02 13:03:44 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:44 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:44 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db Sep 02 13:03:44 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:44 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-31562571-85d5-4f49-acd0-7a22738f91db" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-31562571-85d5-4f49-acd0-7a22738f91db" released by "delete_volume" :: held 0.630s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['cbfac572-8cd3-4fc5-b742-d20911cb22e3', '67517801-25e7-4fe9-9cb1-8dc54051a3f7', '9db81b0b-b552-42f0-9cd4-f62d1bc5e287', 'e8670554-c639-44b3-bcfe-609960ef45e7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:44 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:44 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:44 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7538213b-03fd-4985-9d32-57ac5a65228b tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-31562571-85d5-4f49-acd0-7a22738f91db-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-a1c559f8-4cce-481f-82ef-73ee452dd7c0-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-a1c559f8-4cce-481f-82ef-73ee452dd7c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-a1c559f8-4cce-481f-82ef-73ee452dd7c0" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-a1c559f8-4cce-481f-82ef-73ee452dd7c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8937ec77-899f-4d1d-9a5f-3a62625ec48a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:45 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 Sep 02 13:03:45 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:45 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:45 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0 Sep 02 13:03:45 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:45 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-a1c559f8-4cce-481f-82ef-73ee452dd7c0" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-a1c559f8-4cce-481f-82ef-73ee452dd7c0" released by "delete_volume" :: held 0.637s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['4fdebbbd-ae69-411f-a91c-688d29a60b77', '55dca748-9efa-4931-9380-b74daf7b3ee5', 'cbd61e93-d904-4151-baf1-ff4b1b653086', 'cd65fb71-fe7b-4fb6-a772-27382f174c45'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:45 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:45 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:46 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-502629d4-870a-4aab-9d37-f27359c1afe5 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-a1c559f8-4cce-481f-82ef-73ee452dd7c0-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-9031fc8a-a0ef-49b9-9327-9573489cd8c5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-9031fc8a-a0ef-49b9-9327-9573489cd8c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-9031fc8a-a0ef-49b9-9327-9573489cd8c5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-9031fc8a-a0ef-49b9-9327-9573489cd8c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa3dc4-e879-4b4f-bc88-3f7b1983fbb9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:46 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 Sep 02 13:03:46 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:46 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5 Sep 02 13:03:46 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:46 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-9031fc8a-a0ef-49b9-9327-9573489cd8c5" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-9031fc8a-a0ef-49b9-9327-9573489cd8c5" released by "delete_volume" :: held 0.624s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['ad1630d2-cfe5-4951-b1ff-7c63dcf6ced2', '1374f0da-765a-4dbf-8f17-7e1b3575b29f', 'ac870a4b-de56-488e-afd4-f92ab1e53f55', '37b6f0bb-167a-42dd-9202-bc104dbc7e8d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:47 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:47 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:47 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3e6b6b6-0e2c-4b3a-a829-f49fbc533de0 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-9031fc8a-a0ef-49b9-9327-9573489cd8c5-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-4b9c39cf-a157-4075-9e4c-563c4727c24d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-4b9c39cf-a157-4075-9e4c-563c4727c24d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "cinder-quobyte-4b9c39cf-a157-4075-9e4c-563c4727c24d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-4b9c39cf-a157-4075-9e4c-563c4727c24d" acquired by "delete_volume" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[240faeb8-e24a-4156-81f8-90ea373b3f14]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:47 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d Sep 02 13:03:47 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:47 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:47 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d Sep 02 13:03:47 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:48 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4b9c39cf-a157-4075-9e4c-563c4727c24d" returned: 0 in 0.234s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-quobyte-4b9c39cf-a157-4075-9e4c-563c4727c24d" released by "delete_volume" :: held 0.615s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Created reservations ['94a21d99-903d-4f25-b0d0-0bc04dc3ea41', 'a87a555c-504a-4298-98c2-5d54efd037e2', 'f3e8f414-7409-4294-a2e0-fb3a404e5c2c', 'e035f0ba-f577-4be9-9d46-3549f477924b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:03:48 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:03:48 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:03:48 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:03:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Deleted volume successfully. Sep 02 13:03:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80618442-e1b8-42ff-b3b4-2d3c4c828bb3 tempest-CreateVolumesFromSourceVolumeTest-603928991 None] Lock "cinder-4b9c39cf-a157-4075-9e4c-563c4727c24d-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:03:58 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=100,cinder:UPDATE=140,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:03:58 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=139,cinder:SELECT=87,cinder:DELETE=15,cinder:INSERT=30 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (3908a430-43de-4c2c-879e-dd60a53265a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab9534-abe4-4333-897d-817828e33dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfab9534-abe4-4333-897d-817828e33dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161847144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6fd8e3-a0bc-4964-80db-a1eda795d07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:04Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba6b402-a728-43cd-9744-d3659f6c89eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba6b402-a728-43cd-9744-d3659f6c89eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d730a77-2b9d-4509-87a9-b1c2753d6f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d730a77-2b9d-4509-87a9-b1c2753d6f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6fd8e3-a0bc-4964-80db-a1eda795d07d', 'volume_name': 'volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e89f5a4-c358-4ac8-9075-26fc792e64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e89f5a4-c358-4ac8-9075-26fc792e64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab7c2e0-718c-4b96-af54-7e635daca491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Volume cd6fd8e3-a0bc-4964-80db-a1eda795d07d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d', 'volume_size': 1} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161847144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6fd8e3-a0bc-4964-80db-a1eda795d07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:04Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Creating volume cd6fd8e3-a0bc-4964-80db-a1eda795d07d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:04 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:04 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d 1073741824 Sep 02 13:04:04 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (ecdf529e-0595-486f-9cf7-afd0a77c18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d67718-8bc4-46bd-a313-b204746b59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d67718-8bc4-46bd-a313-b204746b59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702722141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fe894f-e736-4537-a7be-f92fcf4b61bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666e66e5-804f-4159-9e4c-d672801a3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666e66e5-804f-4159-9e4c-d672801a3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2170afc-601a-4332-91d9-5b69013c81ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2170afc-601a-4332-91d9-5b69013c81ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03fe894f-e736-4537-a7be-f92fcf4b61bd', 'volume_name': 'volume-03fe894f-e736-4537-a7be-f92fcf4b61bd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78abcb8c-106f-429d-9928-784c7d3e3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78abcb8c-106f-429d-9928-784c7d3e3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d69d50-170d-4199-927a-2199b90e5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume 03fe894f-e736-4537-a7be-f92fcf4b61bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03fe894f-e736-4537-a7be-f92fcf4b61bd', 'volume_size': 1} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (77d97403-aa28-43f8-b033-5727c9385a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a22820-d7aa-4307-a3b8-d55ca382628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a22820-d7aa-4307-a3b8-d55ca382628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810684010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f388a499-4a5f-45d9-8e8e-735cc5f5f7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c40e13-1283-45a6-9947-34268ca5bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c40e13-1283-45a6-9947-34268ca5bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a63ff45-4654-4af1-a1bd-7c6c2facbf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a63ff45-4654-4af1-a1bd-7c6c2facbf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f388a499-4a5f-45d9-8e8e-735cc5f5f7d0', 'volume_name': 'volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61554d9-b929-40b0-a861-50df10fe0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61554d9-b929-40b0-a861-50df10fe0139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a61cbaa-f6fa-4bf0-9b2a-e820185c3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Volume f388a499-4a5f-45d9-8e8e-735cc5f5f7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0', 'volume_size': 1} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:05 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d 1073741824" returned: 0 in 0.697s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:05 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d Sep 02 13:04:05 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (e86e1a9c-f592-42f6-8b12-9fcc5919aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e7032f-c799-43e0-8bf0-f08379f4859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e7032f-c799-43e0-8bf0-f08379f4859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027135589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe94229-92e3-4055-a8bc-9b70a06ee056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d30737-f378-40a1-9669-94b585b251ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d30737-f378-40a1-9669-94b585b251ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb0e1a7-2c5b-402b-89a1-8f3bbc43df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb0e1a7-2c5b-402b-89a1-8f3bbc43df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe94229-92e3-4055-a8bc-9b70a06ee056', 'volume_name': 'volume-abe94229-92e3-4055-a8bc-9b70a06ee056', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71ca0c5-2aab-48e0-9401-38e8dce9d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71ca0c5-2aab-48e0-9401-38e8dce9d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1854b83-46af-4098-9786-2ec0f14ea162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Volume abe94229-92e3-4055-a8bc-9b70a06ee056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe94229-92e3-4055-a8bc-9b70a06ee056', 'volume_size': 1} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:05 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702722141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fe894f-e736-4537-a7be-f92fcf4b61bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume 03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:05 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd 1073741824 Sep 02 13:04:05 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab7c2e0-718c-4b96-af54-7e635daca491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef213875-0443-4911-bd51-f31e2f769deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Volume volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d (cd6fd8e3-a0bc-4964-80db-a1eda795d07d): created successfully Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef213875-0443-4911-bd51-f31e2f769deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (3908a430-43de-4c2c-879e-dd60a53265a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5bcab30a-0ab7-470e-8e79-e37e4bf5ed16 tempest-CreateVolumesFromImageTest-864046074 None] Created volume successfully. Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (44ea0970-0645-44ae-9a1e-0df0450acb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33fe3d-fe16-414b-b381-ea9f1e16bc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33fe3d-fe16-414b-b381-ea9f1e16bc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1057762909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649f83-ddd6-4ffa-b200-f84d95b46dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:06Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536462bf-5dfa-4bce-ab69-6215d443010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536462bf-5dfa-4bce-ab69-6215d443010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5c5559-8d8b-4324-b1ee-301f50317690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5c5559-8d8b-4324-b1ee-301f50317690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b649f83-ddd6-4ffa-b200-f84d95b46dfc', 'volume_name': 'volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef6acf6-1c52-4387-a7a0-3ecb571b04c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef6acf6-1c52-4387-a7a0-3ecb571b04c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ae9de-7a33-4264-b5ec-11394763b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Volume 6b649f83-ddd6-4ffa-b200-f84d95b46dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc', 'volume_size': 1} Sep 02 13:04:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:06 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (11a6b7fb-db19-4c5e-ad04-6982375b825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c666498-c8be-4358-8273-0619438151de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd 1073741824" returned: 0 in 0.758s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c666498-c8be-4358-8273-0619438151de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-805222267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:06Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e43b86e-f4d6-4770-a7a0-c2958f25c191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e43b86e-f4d6-4770-a7a0-c2958f25c191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5450c3-800f-4ddd-85f3-979236a7cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5450c3-800f-4ddd-85f3-979236a7cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0', 'volume_name': 'volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ba2410-1ab8-431a-91fa-11a5b7118e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ba2410-1ab8-431a-91fa-11a5b7118e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988cf3c2-08aa-411c-9083-b32d3cc4cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Volume 41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0', 'volume_size': 1} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:06 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd Sep 02 13:04:06 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:06 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810684010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f388a499-4a5f-45d9-8e8e-735cc5f5f7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Creating volume f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d69d50-170d-4199-927a-2199b90e5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fe894f-e736-4537-a7be-f92fcf4b61bd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 1073741824 Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6c6d12-f9be-4c1c-9c76-39c2b669ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:06 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-03fe894f-e736-4537-a7be-f92fcf4b61bd (03fe894f-e736-4537-a7be-f92fcf4b61bd): created successfully Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6c6d12-f9be-4c1c-9c76-39c2b669ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (ecdf529e-0595-486f-9cf7-afd0a77c18d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0eb6c745-9a8e-4e74-9933-0d7a00ffabb1 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:07 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 1073741824" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:07 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 Sep 02 13:04:07 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:07 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.177s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027135589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe94229-92e3-4055-a8bc-9b70a06ee056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:05Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Creating volume abe94229-92e3-4055-a8bc-9b70a06ee056 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:07 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a61cbaa-f6fa-4bf0-9b2a-e820185c3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3974a57-091c-4d50-9259-39ebd3ad17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:07 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 1073741824 Sep 02 13:04:07 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Volume volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 (f388a499-4a5f-45d9-8e8e-735cc5f5f7d0): created successfully Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3974a57-091c-4d50-9259-39ebd3ad17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (77d97403-aa28-43f8-b033-5727c9385a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-035f7ee3-a4ee-4ca4-9b79-d755e0cf1dc6 tempest-CreateVolumesFromImageTest-864046074 None] Created volume successfully. Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:08 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 1073741824" returned: 0 in 0.581s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:08 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 Sep 02 13:04:08 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:08 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.590s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1057762909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649f83-ddd6-4ffa-b200-f84d95b46dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:06Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Creating volume 6b649f83-ddd6-4ffa-b200-f84d95b46dfc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:08 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc 1073741824 Sep 02 13:04:08 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1854b83-46af-4098-9786-2ec0f14ea162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe94229-92e3-4055-a8bc-9b70a06ee056', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129e35b-6156-40ea-85c0-0bbde15d0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Volume volume-abe94229-92e3-4055-a8bc-9b70a06ee056 (abe94229-92e3-4055-a8bc-9b70a06ee056): created successfully Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129e35b-6156-40ea-85c0-0bbde15d0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (e86e1a9c-f592-42f6-8b12-9fcc5919aba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c321e39-90b2-4cc7-9920-dc566e9d0dd5 tempest-CreateVolumesFromImageTest-864046074 None] Created volume successfully. Sep 02 13:04:09 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc 1073741824" returned: 0 in 0.543s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:09 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc Sep 02 13:04:09 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:09 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.080s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-805222267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea733c4ceb6b46f38b9bb2476e2a4eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:06Z,use_quota=True,user_id='fd798ddbee6f434580cfdf22aa9642cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Creating volume 41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:09 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:09 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 1073741824 Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ae9de-7a33-4264-b5ec-11394763b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:09 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dfc59a-fa98-40c5-8537-b1e6e0a25f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Volume volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc (6b649f83-ddd6-4ffa-b200-f84d95b46dfc): created successfully Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dfc59a-fa98-40c5-8537-b1e6e0a25f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (44ea0970-0645-44ae-9a1e-0df0450acb37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c59e6160-d3ed-4d4e-b66e-a62474ca09f5 tempest-CreateVolumesFromImageTest-864046074 None] Created volume successfully. Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Flow 'volume_create_manager' (aa31031f-6617-4ffd-ae6f-1baa23b8e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b13b24-027e-4b9f-806e-184c54242ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b13b24-027e-4b9f-806e-184c54242ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a618fe-c1f6-48e4-bc3a-c83b2b568555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21efd4ad5a1495e840a28e87474fcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:10Z,use_quota=True,user_id='b5f2b99349034744ae108e700c570b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c0218e7-7d6a-4902-8c34-6fa5976cac3a),volume_type_id=4c0218e7-7d6a-4902-8c34-6fa5976cac3a)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b128ac-4814-48fc-bf70-6c634d05f581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b128ac-4814-48fc-bf70-6c634d05f581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa2332-fbe3-4c63-af9e-ccecf5516645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 13:04:09 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 1073741824" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 Sep 02 13:04:10 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa2332-fbe3-4c63-af9e-ccecf5516645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03a618fe-c1f6-48e4-bc3a-c83b2b568555', 'volume_name': 'volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555', 'volume_size': 1, 'image_id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe06c550a83284cae235cb638254475f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e21efd4ad5a1495e840a28e87474fcea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11ebe0d8ec5c4c9581e5bd7f346493b70fa9f8c3bd35eeff263100e28ab776c7884b2e010ff41473fce041b21395571917a8151c1572ea1a3d6192b989d69e7d', 'id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd1bcdb-5cca-4bfa-abee-133940582a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd1bcdb-5cca-4bfa-abee-133940582a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a092c03e-44a2-49f1-b88b-126897963a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555', 'volume_size': 1, 'image_id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe06c550a83284cae235cb638254475f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e21efd4ad5a1495e840a28e87474fcea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11ebe0d8ec5c4c9581e5bd7f346493b70fa9f8c3bd35eeff263100e28ab776c7884b2e010ff41473fce041b21395571917a8151c1572ea1a3d6192b989d69e7d', 'id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Trying to clone 03a618fe-c1f6-48e4-bc3a-c83b2b568555 from image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 13:04:10 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 13:04:10 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Image download 0.00 MB at 0.00 MB/s Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.311s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988cf3c2-08aa-411c-9083-b32d3cc4cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86cb7ec-3edc-46d5-be87-4e573d725b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating offline snapshot 6c84962f-1cd0-4d0f-801b-abc036e36d5c of volume 03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[05574d10-78c2-4576-a75f-b0c738dafe46]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb005fd-215f-4947-843d-08c8263142e0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Volume volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 (41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0): created successfully Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86cb7ec-3edc-46d5-be87-4e573d725b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Flow 'volume_create_manager' (11a6b7fb-db19-4c5e-ad04-6982375b825e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2dd4b9f2-a83d-42c6-a86d-3fdfc957ba72 tempest-CreateVolumesFromImageTest-864046074 None] Created volume successfully. Sep 02 13:04:10 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:10 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:10 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd Sep 02 13:04:10 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:10 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-quobyte-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:10 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e145c9a-e7d7-432e-91a6-14692f46ce0e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:10 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c 1G Sep 02 13:04:10 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:10 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:10 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 Sep 02 13:04:11 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Temporary image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da is fetched for user b5f2b99349034744ae108e700c570b9b. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886809c-2af8-445b-9ba6-ecf6a7bf752d]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0 Sep 02 13:04:11 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:11 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c 1G" returned: 0 in 0.600s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fe894f-e736-4537-a7be-f92fcf4b61bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fe894f-e736-4537-a7be-f92fcf4b61bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c Sep 02 13:04:11 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0" released by "delete_volume" :: held 0.805s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:11 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Created reservations ['5195cdf0-a434-40b6-9b9a-90a1ff8bc4c6', 'fb6bf506-36a6-43b8-9889-a28a1bb04e33', '8c405829-b164-48e3-85e0-ed2a7cf09e76', '15b654c9-eda5-468e-ad6a-1dae9dc7240c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:11 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:11 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:11 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fe894f-e736-4537-a7be-f92fcf4b61bd -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c is being set with open permissions: ugo+rw Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:11 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:11 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c Sep 02 13:04:11 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-6b649f83-ddd6-4ffa-b200-f84d95b46dfc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-6b649f83-ddd6-4ffa-b200-f84d95b46dfc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-quobyte-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:12 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c7e0d-eafd-43f9-aa8e-83cc5f4ba0a8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:12 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Deleted volume successfully. Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2eac29d7-5f8f-46e4-8dfc-268f29bf6832 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-41371ee5-f7c4-4f96-b04c-c0ae0c5ab6c0-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:12 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc Sep 02 13:04:12 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:12 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info Sep 02 13:04:12 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:12 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info is being set with open permissions: ugo+rw Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:12 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:12 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info Sep 02 13:04:12 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:12 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc Sep 02 13:04:12 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:12 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.info" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a618fe-c1f6-48e4-bc3a-c83b2b568555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21efd4ad5a1495e840a28e87474fcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:10Z,use_quota=True,user_id='b5f2b99349034744ae108e700c570b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c0218e7-7d6a-4902-8c34-6fa5976cac3a),volume_type_id=4c0218e7-7d6a-4902-8c34-6fa5976cac3a)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Creating volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:12 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:12 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:12 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1073741824 Sep 02 13:04:12 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-6b649f83-ddd6-4ffa-b200-f84d95b46dfc" released by "delete_volume" :: held 0.803s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82600d8d-26e4-48b6-9b68-c8cbf63c984d tempest-CreateVolumesFromSnapshotTest-1203578 None] Create snapshot completed successfully Sep 02 13:04:12 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Created reservations ['77d16347-3728-486d-abe2-4c01dd249cba', '4308cec8-82a2-4b02-a321-8907f4a812bb', '15cf7415-9686-44fc-a251-737ed0ea8eb7', '700eb55b-5932-4a39-a357-f99461249321'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:13 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:13 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-abe94229-92e3-4055-a8bc-9b70a06ee056-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-abe94229-92e3-4055-a8bc-9b70a06ee056-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-quobyte-abe94229-92e3-4055-a8bc-9b70a06ee056" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-abe94229-92e3-4055-a8bc-9b70a06ee056" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:13 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[03616ed9-4de4-4cb9-95c2-517428c389cb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Deleted volume successfully. Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-620b0c36-5866-4f14-bc56-3e5c371b111a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-6b649f83-ddd6-4ffa-b200-f84d95b46dfc-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:13 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1073741824" returned: 0 in 0.659s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:13 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 Sep 02 13:04:13 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:13 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 Sep 02 13:04:13 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:13 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:13 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056 Sep 02 13:04:13 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:13 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:13 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Attempting download of 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da ((None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}])) to volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (eb8ebd29-fe37-428f-8cde-aa745e117f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b38d8-b58b-4d39-a8b5-3826a77fdd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[654fdcd0-bcbf-4b6e-9e20-16ac63cd2845]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b38d8-b58b-4d39-a8b5-3826a77fdd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102839489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb697b3-0a3e-47b1-8c6e-45d86278a9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:14Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f681419-4234-41c4-a6b8-1b21bd45b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f681419-4234-41c4-a6b8-1b21bd45b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3162d326-8f30-4c99-bab8-00162b0eaf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3162d326-8f30-4c99-bab8-00162b0eaf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb697b3-0a3e-47b1-8c6e-45d86278a9f2', 'volume_name': 'volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9528f01-9822-44e1-a617-8793306b75d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9528f01-9822-44e1-a617-8793306b75d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd423d9-da84-4931-bdde-4216f720257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume acb697b3-0a3e-47b1-8c6e-45d86278a9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2', 'volume_size': 1} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102839489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb697b3-0a3e-47b1-8c6e-45d86278a9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:14Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume acb697b3-0a3e-47b1-8c6e-45d86278a9f2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:14 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:14 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6 Sep 02 13:04:14 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:14 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-abe94229-92e3-4055-a8bc-9b70a06ee056" returned: 0 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-abe94229-92e3-4055-a8bc-9b70a06ee056" released by "delete_volume" :: held 0.882s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:14 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 1073741824 Sep 02 13:04:14 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Created reservations ['2e6d8e6f-0524-49b3-9d80-8781cd1958ad', '2c3d428a-3c65-4a8f-b357-96d6fcd7534a', 'df92db06-dd55-4e8c-bf79-fe68471058aa', 'adc52787-aaf3-4faf-9c4c-b20ee3dc7d6c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:14 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:14 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:14 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-quobyte-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc53a9-d147-4fb1-b2a5-c8ecc64875a3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:14 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6 Sep 02 13:04:14 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:14 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 Sep 02 13:04:14 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:14 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.516s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Deleted volume successfully. Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-df8b7677-c7b5-4a1e-a146-3c9d0fdfe1ce tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-abe94229-92e3-4055-a8bc-9b70a06ee056-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:14 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (203d66a8-b27f-41de-bd92-332c190c8162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6971d6d6-d94d-405d-be45-39f087ef85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 1073741824" returned: 0 in 0.843s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6971d6d6-d94d-405d-be45-39f087ef85b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505730653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b991e6e-8f61-49e4-8840-b1fe22e94418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:15Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094a54e7-ff43-4276-8f44-f795329df873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094a54e7-ff43-4276-8f44-f795329df873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e6dab8-247e-4f35-8b2d-ed88c01f0662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e6dab8-247e-4f35-8b2d-ed88c01f0662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b991e6e-8f61-49e4-8840-b1fe22e94418', 'volume_name': 'volume-5b991e6e-8f61-49e4-8840-b1fe22e94418', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d501b7-61ff-4eee-adee-75a9df88a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d501b7-61ff-4eee-adee-75a9df88a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363e73f7-74d5-4b85-84e6-361c3670b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume 5b991e6e-8f61-49e4-8840-b1fe22e94418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b991e6e-8f61-49e4-8840-b1fe22e94418', 'volume_size': 1} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:15 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6" returned: 1 in 0.675s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_w86y4gc6' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751607e-7ea6-4223-80f5-920f3e297e09]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:15 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 Sep 02 13:04:15 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:15 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" returned: 0 in 0.675s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:15 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0 Sep 02 13:04:15 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:15 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:15 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:15 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505730653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b991e6e-8f61-49e4-8840-b1fe22e94418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:15Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume 5b991e6e-8f61-49e4-8840-b1fe22e94418 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:15 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:15 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 1073741824 Sep 02 13:04:15 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (8cb082b4-a72b-4046-98c9-3017ddfd7fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f91da3-a46a-488c-9657-9b40da94dd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd423d9-da84-4931-bdde-4216f720257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b459dda-aef1-4235-b447-0ac629e213c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f91da3-a46a-488c-9657-9b40da94dd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43538089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7533e598-b805-47ac-86e2-ace6f721ccb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:15Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47527c-7244-4565-91e2-214c3223f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f47527c-7244-4565-91e2-214c3223f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a6b188-c431-4daf-a2f2-23548883f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a6b188-c431-4daf-a2f2-23548883f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7533e598-b805-47ac-86e2-ace6f721ccb6', 'volume_name': 'volume-7533e598-b805-47ac-86e2-ace6f721ccb6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f2fc28-1d39-44f2-bb49-609f46c6f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f2fc28-1d39-44f2-bb49-609f46c6f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3d9dc-8df6-4892-8147-282ce2cf9d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume 7533e598-b805-47ac-86e2-ace6f721ccb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7533e598-b805-47ac-86e2-ace6f721ccb6', 'volume_size': 1} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 (acb697b3-0a3e-47b1-8c6e-45d86278a9f2): created successfully Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b459dda-aef1-4235-b447-0ac629e213c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (eb8ebd29-fe37-428f-8cde-aa745e117f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:15 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 0 in 0.682s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-735e3917-9c0f-4881-837a-81dbdfdf48f9 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:15 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" returned: 0 in 0.636s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0" released by "delete_volume" :: held 1.377s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:16 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD Sep 02 13:04:16 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Created reservations ['7d6a3949-15a2-4c9f-873a-d187b389f035', '995b7f10-d927-4e8b-9259-43b0d40073e2', '7b27a7a3-388d-4589-abb4-8e77c8c251f9', '5a574d6c-5ff0-41d6-9f84-79ffb65ccdcb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (1375cebc-ff4d-43f7-be58-f8c94fe59ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c5c25f-218d-4549-b617-67162df42052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:16 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c5c25f-218d-4549-b617-67162df42052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287679505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:16Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f28d77-3c67-4e7d-aa06-c57b27ed71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f28d77-3c67-4e7d-aa06-c57b27ed71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 Sep 02 13:04:16 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b075dc1-5979-4b9d-ab52-3ee9625bcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b075dc1-5979-4b9d-ab52-3ee9625bcae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc', 'volume_name': 'volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aadda2a-578b-4c54-949f-40c5c2cff859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aadda2a-578b-4c54-949f-40c5c2cff859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd17bd7-ec5a-4763-a706-6b54fad3f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume 5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc', 'volume_size': 1} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 1073741824" returned: 0 in 0.892s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:16 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 Sep 02 13:04:16 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:16 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:16 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:16 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43538089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7533e598-b805-47ac-86e2-ace6f721ccb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:15Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume 7533e598-b805-47ac-86e2-ace6f721ccb6 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:16 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:16 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 1073741824 Sep 02 13:04:16 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (54dd5e4f-8989-4f69-b51b-21a3659eac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0e425b-6a24-4f25-9daf-cf2e04d4bb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Deleted volume successfully. Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363e73f7-74d5-4b85-84e6-361c3670b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b991e6e-8f61-49e4-8840-b1fe22e94418', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193adc5f-ee8b-4e9b-b3d8-e68e427ba819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0e425b-6a24-4f25-9daf-cf2e04d4bb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323014514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c172c9-6346-4bdf-aa96-fee1232be46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:17Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb219741-0d57-4280-8e57-479593c0bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb219741-0d57-4280-8e57-479593c0bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582fdcd-4582-4d4d-818b-b109f43a95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582fdcd-4582-4d4d-818b-b109f43a95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c172c9-6346-4bdf-aa96-fee1232be46e', 'volume_name': 'volume-90c172c9-6346-4bdf-aa96-fee1232be46e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b409831f-e4cc-4178-a84c-4c490a945ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b409831f-e4cc-4178-a84c-4c490a945ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022caa4c-7488-4b3b-8a8d-e45373a349a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume 90c172c9-6346-4bdf-aa96-fee1232be46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c172c9-6346-4bdf-aa96-fee1232be46e', 'volume_size': 1} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-cd6fd8e3-a0bc-4964-80db-a1eda795d07d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 (5b991e6e-8f61-49e4-8840-b1fe22e94418): created successfully Sep 02 13:04:17 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193adc5f-ee8b-4e9b-b3d8-e68e427ba819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (203d66a8-b27f-41de-bd92-332c190c8162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0e71486-7bf5-42a5-b640-e3805b832430 tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-f388a499-4a5f-45d9-8e8e-735cc5f5f7d0-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555" returned: 0 in 0.697s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b1ca81c-f5c1-4d20-99b8-18c25f1c72da_tye16py_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-cd6fd8e3-a0bc-4964-80db-a1eda795d07d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4b13c130-6f64-4631-a00d-3c942e44d3dc tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:17 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1G Sep 02 13:04:17 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "cinder-quobyte-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7438e9-ddf2-4950-8d8f-cc707a85a4e4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:17 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d Sep 02 13:04:17 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:17 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 1073741824" returned: 0 in 0.604s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 1G" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Downloaded image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da ((None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}])) to volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Temporary image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da for user b5f2b99349034744ae108e700c570b9b is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Marking volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Copying metadata from image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da to 03a618fe-c1f6-48e4-bc3a-c83b2b568555. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Creating volume glance metadata for volume 03a618fe-c1f6-48e4-bc3a-c83b2b568555 backed by image 3b1ca81c-f5c1-4d20-99b8-18c25f1c72da with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fe06c550a83284cae235cb638254475f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:17 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 Sep 02 13:04:17 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a092c03e-44a2-49f1-b88b-126897963a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555', 'volume_size': 1, 'image_id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe06c550a83284cae235cb638254475f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e21efd4ad5a1495e840a28e87474fcea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11ebe0d8ec5c4c9581e5bd7f346493b70fa9f8c3bd35eeff263100e28ab776c7884b2e010ff41473fce041b21395571917a8151c1572ea1a3d6192b989d69e7d', 'id': '3b1ca81c-f5c1-4d20-99b8-18c25f1c72da', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b1ca81c-f5c1-4d20-99b8-18c25f1c72da/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97b324-7214-4a55-bd7f-24dc90a2eeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Volume volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 (03a618fe-c1f6-48e4-bc3a-c83b2b568555): created successfully Sep 02 13:04:17 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c97b324-7214-4a55-bd7f-24dc90a2eeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Flow 'volume_create_manager' (aa31031f-6617-4ffd-ae6f-1baa23b8e73b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fa48c8ad-8eee-46a9-876d-e5225c1af3ba tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Created volume successfully. Sep 02 13:04:17 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d Sep 02 13:04:17 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:17 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287679505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:16Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume 5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:17 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc 1073741824 Sep 02 13:04:17 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3d9dc-8df6-4892-8147-282ce2cf9d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7533e598-b805-47ac-86e2-ace6f721ccb6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3301b81-db81-4cf3-b1b9-66fc04b4e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-7533e598-b805-47ac-86e2-ace6f721ccb6 (7533e598-b805-47ac-86e2-ace6f721ccb6): created successfully Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3301b81-db81-4cf3-b1b9-66fc04b4e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (8cb082b4-a72b-4046-98c9-3017ddfd7fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:17 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-72f0193c-7c4a-4243-b03b-f180d222bc3e tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-quobyte-cd6fd8e3-a0bc-4964-80db-a1eda795d07d" released by "delete_volume" :: held 0.847s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Created reservations ['d1da883f-b179-4370-aaaf-da6f9b8bdca1', 'd53fdd67-0de7-495c-a9ce-9101c7b39967', 'b2fd0e8d-4f50-494d-b0b2-7f60a5777716', '1412aa35-f5b9-48fd-9bc1-e1adeca22b23'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:18 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:18 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:18 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Deleted volume successfully. Sep 02 13:04:18 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cf1321b1-f54e-4d2b-922f-8b435c1e609a tempest-CreateVolumesFromImageTest-864046074 None] Lock "cinder-cd6fd8e3-a0bc-4964-80db-a1eda795d07d-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc 1073741824" returned: 0 in 0.626s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Acquiring lock "cinder-03a618fe-c1f6-48e4-bc3a-c83b2b568555-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:18 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc Sep 02 13:04:18 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "cinder-03a618fe-c1f6-48e4-bc3a-c83b2b568555-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Acquiring lock "cinder-quobyte-03a618fe-c1f6-48e4-bc3a-c83b2b568555" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "cinder-quobyte-03a618fe-c1f6-48e4-bc3a-c83b2b568555" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f3898-3cab-47e0-ad9b-fde0f5bcad4d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:18 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 Sep 02 13:04:18 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:18 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" returned: 0 in 0.324s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323014514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c172c9-6346-4bdf-aa96-fee1232be46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4b152c280347a69b65925ab21c1c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:17Z,use_quota=True,user_id='0a4e3156380b42bdbba9f23cc2d7a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Creating volume 90c172c9-6346-4bdf-aa96-fee1232be46e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd17bd7-ec5a-4763-a706-6b54fad3f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65438189-0da6-4141-8c53-d032369fbe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:18 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e 1073741824 Sep 02 13:04:18 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc (5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc): created successfully Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65438189-0da6-4141-8c53-d032369fbe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (1375cebc-ff4d-43f7-be58-f8c94fe59ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ce8e5aec-aa96-4d66-9f44-44957bc5c7bf tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:19 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555" returned: 0 in 0.614s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:19 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555 Sep 02 13:04:19 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:19 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e 1073741824" returned: 0 in 0.662s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:19 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03a618fe-c1f6-48e4-bc3a-c83b2b568555" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:19 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e Sep 02 13:04:19 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "cinder-quobyte-03a618fe-c1f6-48e4-bc3a-c83b2b568555" released by "delete_volume" :: held 0.981s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Created reservations ['1d731bf8-8587-4c35-9d6b-3337d8e43060', 'a899c46b-5d46-4956-8703-9aa55ecd54b4', '09482913-f235-4c0a-9ce1-5007d9b343f9', 'c26a253f-af2c-4d5a-aaea-64d0e17b6829'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:19 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:19 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:19 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022caa4c-7488-4b3b-8a8d-e45373a349a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c172c9-6346-4bdf-aa96-fee1232be46e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5116900-7ba3-419a-a7a5-53489e7962c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Volume volume-90c172c9-6346-4bdf-aa96-fee1232be46e (90c172c9-6346-4bdf-aa96-fee1232be46e): created successfully Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5116900-7ba3-419a-a7a5-53489e7962c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Flow 'volume_create_manager' (54dd5e4f-8989-4f69-b51b-21a3659eac6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96ce5d95-3f5a-4e46-ab9c-496855b2b796 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created volume successfully. Sep 02 13:04:20 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Deleted volume successfully. Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10963bca-4307-457c-8f9d-613900e33e10 tempest-VolumeAndVolumeTypeFromImageTest-1388041360 None] Lock "cinder-03a618fe-c1f6-48e4-bc3a-c83b2b568555-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-90c172c9-6346-4bdf-aa96-fee1232be46e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-90c172c9-6346-4bdf-aa96-fee1232be46e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-90c172c9-6346-4bdf-aa96-fee1232be46e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-90c172c9-6346-4bdf-aa96-fee1232be46e" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5288891-3ec5-4f13-a301-2810dfd37386]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:20 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e Sep 02 13:04:20 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:20 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:21 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e Sep 02 13:04:21 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:21 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-90c172c9-6346-4bdf-aa96-fee1232be46e" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-90c172c9-6346-4bdf-aa96-fee1232be46e" released by "delete_volume" :: held 0.848s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['655097b8-5655-4232-acd8-afa84f7246e3', 'b8a031e1-1d03-4189-95eb-48f5d940b2ef', '3e04c51a-c4c9-41d9-9ee6-ebb048419ecb', '4bc72417-dff0-4984-9776-de11fe5b16ca'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:21 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:21 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1e466-792a-4a49-b2e5-243e0f38f814]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:21 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-74c34b08-9e53-4bac-85ea-71eef08f8eea tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-90c172c9-6346-4bdf-aa96-fee1232be46e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:21 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc Sep 02 13:04:21 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:22 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:22 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc Sep 02 13:04:22 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (20107ece-e1f5-45a5-8d09-81112f67a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9279d-abbe-4343-a5e3-ab8bf6f48f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9279d-abbe-4343-a5e3-ab8bf6f48f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460823142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73425ae3-b63e-47c5-adbb-f1018dcb7cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:23Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd48f926-4d90-49ed-93d5-2a8794ec73e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd48f926-4d90-49ed-93d5-2a8794ec73e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ed7263-3b27-4ea0-8543-090252375f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ed7263-3b27-4ea0-8543-090252375f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73425ae3-b63e-47c5-adbb-f1018dcb7cad', 'volume_name': 'volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:22 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847141cb-d0ff-4bf0-b7c1-0e4aa67d5844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847141cb-d0ff-4bf0-b7c1-0e4aa67d5844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb1f26a-8e5d-4778-8c27-fc284606366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 73425ae3-b63e-47c5-adbb-f1018dcb7cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad', 'volume_size': 1} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460823142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73425ae3-b63e-47c5-adbb-f1018dcb7cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:23Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 73425ae3-b63e-47c5-adbb-f1018dcb7cad {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:22 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad 1073741824 Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc" released by "delete_volume" :: held 1.016s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:22 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['4bb36bfc-2d26-48c4-a6e9-4357ba7537d7', '8ee9addb-bca4-4c17-9f7a-2346adfa883c', 'eced489b-7dfe-416e-be51-aecd17ae47be', '96b71e0d-a7ee-4650-9b7e-7e947e803bce'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:22 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:22 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:23 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad 1073741824" returned: 0 in 0.670s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:23 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (c70813c6-6492-442e-a44c-f391898bae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5646ec82-fe2f-4200-84cf-8d8bcc8a5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5646ec82-fe2f-4200-84cf-8d8bcc8a5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383282196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:23Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8655c87-df1b-4963-be25-31cfa093253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8655c87-df1b-4963-be25-31cfa093253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17280c12-a946-48c2-bf20-a7578eaa0794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17280c12-a946-48c2-bf20-a7578eaa0794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f', 'volume_name': 'volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dcbb01-7d4b-44dd-8186-50ba9cb4d884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dcbb01-7d4b-44dd-8186-50ba9cb4d884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7028e1-a58a-4297-8941-dc6564b15d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Volume 429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f', 'volume_size': 1} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-71ec6f8c-e2da-4732-883f-00edc5cd8f99 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-5b4ecbe6-357e-4b01-9d5b-f0f58acd7fcc-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:23 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad Sep 02 13:04:23 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:23 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383282196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:23Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Creating volume 429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb1f26a-8e5d-4778-8c27-fc284606366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f 1073741824 Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f6a56-e95d-48fb-a2cd-9ac1630b0dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:23 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad (73425ae3-b63e-47c5-adbb-f1018dcb7cad): created successfully Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f6a56-e95d-48fb-a2cd-9ac1630b0dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (20107ece-e1f5-45a5-8d09-81112f67a085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8be09176-c64e-4e8f-93d0-011950cbc519 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-7533e598-b805-47ac-86e2-ace6f721ccb6-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-7533e598-b805-47ac-86e2-ace6f721ccb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-7533e598-b805-47ac-86e2-ace6f721ccb6" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-7533e598-b805-47ac-86e2-ace6f721ccb6" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[305f12ff-b846-4d33-9c6b-077588fd70ba]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:24 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 Sep 02 13:04:24 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:24 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f 1073741824" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:24 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f Sep 02 13:04:24 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:24 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:24 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6 Sep 02 13:04:24 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:24 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7028e1-a58a-4297-8941-dc6564b15d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14567d-23e7-4908-9976-73359162f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Volume volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f (429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f): created successfully Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14567d-23e7-4908-9976-73359162f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (c70813c6-6492-442e-a44c-f391898bae8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bfcbd74e-c481-4e5d-a326-f460704a18be tempest-ProjectReaderTests-553561828 None] Created volume successfully. Sep 02 13:04:24 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7533e598-b805-47ac-86e2-ace6f721ccb6" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-7533e598-b805-47ac-86e2-ace6f721ccb6" released by "delete_volume" :: held 0.834s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['4ec5309c-7581-49de-8a69-12a1acb281a0', '63ea7333-53d7-4f98-a46d-2466a424985f', '01e21567-4a7d-4a69-b452-1686dcae020f', '3fcacccb-1e94-4da6-a59d-d2340945c17b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:25 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:25 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-5b991e6e-8f61-49e4-8840-b1fe22e94418-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-5b991e6e-8f61-49e4-8840-b1fe22e94418-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-5b991e6e-8f61-49e4-8840-b1fe22e94418" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-5b991e6e-8f61-49e4-8840-b1fe22e94418" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (ca0a46bb-591a-4a4e-9e5d-030ccec49cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd34cb2-8229-4cd4-bcf0-b3a6c9db1424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:25 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d395e9-e8bf-4cdb-9264-f2202ba19035]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.475s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd34cb2-8229-4cd4-bcf0-b3a6c9db1424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946103623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0df139-d6b0-47a9-9707-7c9ca28e629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:25Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9510c646-c413-4140-bb09-f6ee7b15028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9510c646-c413-4140-bb09-f6ee7b15028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c9ffd6-a094-4e2a-8e00-ec69ce1f196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c9ffd6-a094-4e2a-8e00-ec69ce1f196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0df139-d6b0-47a9-9707-7c9ca28e629a', 'volume_name': 'volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b751f6-84b1-4d25-b206-559f16f61f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b751f6-84b1-4d25-b206-559f16f61f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27737e7-935f-48b9-91e2-4220492e3a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 7c0df139-d6b0-47a9-9707-7c9ca28e629a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a', 'volume_size': 1} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946103623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0df139-d6b0-47a9-9707-7c9ca28e629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:25Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 7c0df139-d6b0-47a9-9707-7c9ca28e629a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:25 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 Sep 02 13:04:25 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:25 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:25 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a 1073741824 Sep 02 13:04:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c90bd3a6-3612-432d-aea5-d3b8766ab911 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-7533e598-b805-47ac-86e2-ace6f721ccb6-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:25 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (5e20c86a-abc0-4844-b342-2d7fd013600f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e0b16-5ccf-48e2-a7ad-bf7f8141cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e0b16-5ccf-48e2-a7ad-bf7f8141cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-948707230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a48559-5fd1-41a8-9f0e-562e13441430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:26Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92ef1a-7b84-4a8e-99f8-6fa43b2b7d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc92ef1a-7b84-4a8e-99f8-6fa43b2b7d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f034f93d-2dcf-451e-976a-e9acbd740aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f034f93d-2dcf-451e-976a-e9acbd740aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a48559-5fd1-41a8-9f0e-562e13441430', 'volume_name': 'volume-98a48559-5fd1-41a8-9f0e-562e13441430', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b989558-175c-4f92-a4ea-7e1290da1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b989558-175c-4f92-a4ea-7e1290da1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f61fca-845d-4afa-95fa-0ed80eda86ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 98a48559-5fd1-41a8-9f0e-562e13441430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a48559-5fd1-41a8-9f0e-562e13441430', 'volume_size': 1} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:26 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418" returned: 0 in 0.703s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:26 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418 Sep 02 13:04:26 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "cinder-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-quobyte-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530c94f-491c-4f5a-a205-2f5067a01170]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:26 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:26 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f Sep 02 13:04:26 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a 1073741824" returned: 0 in 0.973s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:26 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-5b991e6e-8f61-49e4-8840-b1fe22e94418" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (c3a93a87-4651-42bf-97da-b0c22caee9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842dd523-e644-4bdb-bdc2-0c51ed30800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-5b991e6e-8f61-49e4-8840-b1fe22e94418" released by "delete_volume" :: held 1.281s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842dd523-e644-4bdb-bdc2-0c51ed30800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493318104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c63277c-1c9a-47dd-ba32-b90734c56363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:27Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4335e5d-4760-490a-b5a9-716e624411f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4335e5d-4760-490a-b5a9-716e624411f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51118154-3e76-48f1-bae5-b5a5d9600941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51118154-3e76-48f1-bae5-b5a5d9600941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c63277c-1c9a-47dd-ba32-b90734c56363', 'volume_name': 'volume-7c63277c-1c9a-47dd-ba32-b90734c56363', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf73c79-c261-4921-84fe-72105db9d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf73c79-c261-4921-84fe-72105db9d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd34d6e-1cee-4a59-b157-23123515f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 7c63277c-1c9a-47dd-ba32-b90734c56363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c63277c-1c9a-47dd-ba32-b90734c56363', 'volume_size': 1} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:26 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a Sep 02 13:04:26 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['d7e4cac0-0e23-49a5-aff0-b6d3822df6ec', '008f51f7-c592-44c6-8ac2-8e5e122980bc', 'b6bf2cfa-4bed-4c3f-848f-6c8d49f16466', 'aa1f2dc2-b281-4b6a-a587-7c9962a26001'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:26 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" returned: 0 in 0.597s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:27 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:27 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:27 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f Sep 02 13:04:27 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:27 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-948707230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a48559-5fd1-41a8-9f0e-562e13441430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:26Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 98a48559-5fd1-41a8-9f0e-562e13441430 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:27 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 1073741824 Sep 02 13:04:27 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27737e7-935f-48b9-91e2-4220492e3a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c1f408-6a4f-468e-a8ea-01056cc939cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (fed72ddd-69d8-4a4c-98b4-9da36c7237e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec2e349-83c7-413e-a228-4e322ec9ff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a (7c0df139-d6b0-47a9-9707-7c9ca28e629a): created successfully Sep 02 13:04:27 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c1f408-6a4f-468e-a8ea-01056cc939cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (ca0a46bb-591a-4a4e-9e5d-030ccec49cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec2e349-83c7-413e-a228-4e322ec9ff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891033220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3c6939-30da-42e2-8cb8-462b4f8cda42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:27Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6962c50a-322f-4821-83ae-80e7641405a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6962c50a-322f-4821-83ae-80e7641405a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4e4d2b-1990-450a-9520-9f9f221f737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4e4d2b-1990-450a-9520-9f9f221f737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3c6939-30da-42e2-8cb8-462b4f8cda42', 'volume_name': 'volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd681ec6-dc03-4731-adc8-5af8aa1c0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd681ec6-dc03-4731-adc8-5af8aa1c0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaeca85-1a6a-4f54-8c46-7b7df6188f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 2a3c6939-30da-42e2-8cb8-462b4f8cda42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42', 'volume_size': 1} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" returned: 0 in 0.589s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d67a299-7f87-4447-85be-e94e1704ec1d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-acb697b3-0a3e-47b1-8c6e-45d86278a9f2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-337e43b7-77aa-445a-8a29-6758a6fbb15f tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-5b991e6e-8f61-49e4-8840-b1fe22e94418-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f" released by "delete_volume" :: held 1.305s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-acb697b3-0a3e-47b1-8c6e-45d86278a9f2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (03c38706-72f9-4ba1-8d25-60ac8c0b7c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5ddddb-ad39-4aed-8234-9acc939041e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5ddddb-ad39-4aed-8234-9acc939041e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400150326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2daaf8-b394-4517-b3a9-ef9132a91f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:28Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b880ec4d-87c8-4a6f-9ab0-f1affcd03dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b880ec4d-87c8-4a6f-9ab0-f1affcd03dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace15ed4-cb20-446b-a3ed-829fa4184e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace15ed4-cb20-446b-a3ed-829fa4184e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2daaf8-b394-4517-b3a9-ef9132a91f6c', 'volume_name': 'volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa226071-370b-41f6-a855-dfba0a2240fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa226071-370b-41f6-a855-dfba0a2240fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68cfd12-a0ff-4d17-9a2a-6d95acd1a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume 0a2daaf8-b394-4517-b3a9-ef9132a91f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c', 'volume_size': 1} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Created reservations ['12357e8a-f9be-4031-8fcd-1e5a693aea90', '489e76e3-9a78-4ffc-b3d3-73c2628ca9d0', 'c343e250-4ac4-450d-a81c-09de4b875d64', '58494cca-de45-4a9b-8e75-55a92a052c6b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[43689724-b264-45f4-86ba-e89c68550f8f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:27 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 1073741824" returned: 0 in 0.794s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:28 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:28 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:28 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 Sep 02 13:04:28 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:28 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 Sep 02 13:04:28 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:28 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493318104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c63277c-1c9a-47dd-ba32-b90734c56363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:27Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 7c63277c-1c9a-47dd-ba32-b90734c56363 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:28 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:28 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Deleted volume successfully. Sep 02 13:04:28 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 1073741824 Sep 02 13:04:28 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f61fca-845d-4afa-95fa-0ed80eda86ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a48559-5fd1-41a8-9f0e-562e13441430', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacae686-0509-491e-b8ea-8f7ee9ff8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:28 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2 Sep 02 13:04:28 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-98a48559-5fd1-41a8-9f0e-562e13441430 (98a48559-5fd1-41a8-9f0e-562e13441430): created successfully Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacae686-0509-491e-b8ea-8f7ee9ff8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (5e20c86a-abc0-4844-b342-2d7fd013600f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04ac19ad-5eae-44aa-95f7-64cbd2e1da62 tempest-ProjectReaderTests-553561828 None] Lock "cinder-429144e7-0fe8-4b4f-ba95-b30a9dd6ac6f-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b50a5274-e73f-4b5f-8c2f-cfc538d64ae7 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:28 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-acb697b3-0a3e-47b1-8c6e-45d86278a9f2" released by "delete_volume" :: held 0.946s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['2d3841c3-9957-491a-97bf-1ba3c6a12bbc', '3bcf4b1e-575b-460d-ad8d-4110c063b434', '7a2b163b-647f-4fdf-860e-0d3696c90447', '255c191b-f606-484f-87c3-a89f5d05f733'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:29 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:29 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:29 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 1073741824" returned: 0 in 0.737s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (b160edcf-b4f2-4704-93b3-53423933ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b954f16-22c2-4068-8b7d-bd69aa759d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:29 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 Sep 02 13:04:29 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b954f16-22c2-4068-8b7d-bd69aa759d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040758317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b105b-51e2-4d2f-803d-be4b06f3926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:29Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce40b74-f197-405b-8e60-b4fe95c98e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce40b74-f197-405b-8e60-b4fe95c98e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4d4b36-d556-4353-86a8-ba731b311e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4d4b36-d556-4353-86a8-ba731b311e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230b105b-51e2-4d2f-803d-be4b06f3926b', 'volume_name': 'volume-230b105b-51e2-4d2f-803d-be4b06f3926b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482dd42-124c-477d-9cab-3b864a7f1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9482dd42-124c-477d-9cab-3b864a7f1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ec3b63-777e-4032-aa7c-eb201f74de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Volume 230b105b-51e2-4d2f-803d-be4b06f3926b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230b105b-51e2-4d2f-803d-be4b06f3926b', 'volume_size': 1} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:29 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6313466-e60d-42f7-99da-e0510235cdc7 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-acb697b3-0a3e-47b1-8c6e-45d86278a9f2-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:29 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.911s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891033220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3c6939-30da-42e2-8cb8-462b4f8cda42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:27Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 2a3c6939-30da-42e2-8cb8-462b4f8cda42 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:29 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd34d6e-1cee-4a59-b157-23123515f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c63277c-1c9a-47dd-ba32-b90734c56363', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b0568-b6d4-42b8-a3be-14f9c9409377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:29 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 1073741824 Sep 02 13:04:29 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-7c63277c-1c9a-47dd-ba32-b90734c56363 (7c63277c-1c9a-47dd-ba32-b90734c56363): created successfully Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b0568-b6d4-42b8-a3be-14f9c9409377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (c3a93a87-4651-42bf-97da-b0c22caee9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a594ff63-4aad-4af4-99f7-8db6178bb16d tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-6c84962f-1cd0-4d0f-801b-abc036e36d5c-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:29 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 1073741824" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-6c84962f-1cd0-4d0f-801b-abc036e36d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-6c84962f-1cd0-4d0f-801b-abc036e36d5c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-6c84962f-1cd0-4d0f-801b-abc036e36d5c" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleting offline snapshot 6c84962f-1cd0-4d0f-801b-abc036e36d5c of volume 03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:04:30 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 Sep 02 13:04:30 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] snapshot_file for this snap is: volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8495a1-5082-4d60-b84b-c2bccd91b89f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:30 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c Sep 02 13:04:30 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:30 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400150326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2daaf8-b394-4517-b3a9-ef9132a91f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41747078b33b46be8d9c5a2da0b8b722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:28Z,use_quota=True,user_id='528da5a261ae4043a6f296516bdc391e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Creating volume 0a2daaf8-b394-4517-b3a9-ef9132a91f6c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:30 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaeca85-1a6a-4f54-8c46-7b7df6188f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:30 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c 1073741824 Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6255f67-50c7-4f92-9ca9-1ae442dfaa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:30 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:30 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 (2a3c6939-30da-42e2-8cb8-462b4f8cda42): created successfully Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6255f67-50c7-4f92-9ca9-1ae442dfaa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (fed72ddd-69d8-4a4c-98b4-9da36c7237e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2ce48dae-6de2-49a7-beca-6f43c9bc59c6 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:30 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c" returned: 0 in 0.445s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03fe894f-e736-4537-a7be-f92fcf4b61bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf70273-19ff-4aac-9d33-a0ebd1fcca1a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:30 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd Sep 02 13:04:30 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:30 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c 1073741824" returned: 0 in 0.512s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:30 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c Sep 02 13:04:30 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:30 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Flow 'volume_create_manager' (fbc01015-aced-45ad-9817-5074ba59c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a2e5b-2d1d-4db5-a805-73f14d41dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a2e5b-2d1d-4db5-a805-73f14d41dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935c39c-afe2-4513-a859-79e39b768fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c15cd37d504110a3dc97c49423b9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:31Z,use_quota=True,user_id='8d31e4841d6740e89d29cc8f5fc3633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6acfbc3-04e1-48fe-b69e-50f564a3b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6acfbc3-04e1-48fe-b69e-50f564a3b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f84660-e227-486a-98c9-9508579bd650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 13:04:31 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:31 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c Sep 02 13:04:31 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:31 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040758317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b105b-51e2-4d2f-803d-be4b06f3926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:29Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Creating volume 230b105b-51e2-4d2f-803d-be4b06f3926b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:31 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:31 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b 1073741824 Sep 02 13:04:31 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68cfd12-a0ff-4d17-9a2a-6d95acd1a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3cf3c-7de5-43c7-af7c-62875c0816f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Volume volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c (0a2daaf8-b394-4517-b3a9-ef9132a91f6c): created successfully Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e3cf3c-7de5-43c7-af7c-62875c0816f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Flow 'volume_create_manager' (03c38706-72f9-4ba1-8d25-60ac8c0b7c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-62e062b0-1396-42d7-8348-53f59de012f8 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created volume successfully. Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f84660-e227-486a-98c9-9508579bd650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2935c39c-afe2-4513-a859-79e39b768fe9', 'volume_name': 'volume-2935c39c-afe2-4513-a859-79e39b768fe9', 'volume_size': 1, 'image_id': '97a87809-dbc0-4758-993d-f63918679b2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be6f2e640458184473df591a6874ec91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26c15cd37d504110a3dc97c49423b9c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58a22957efca458b28e982f8077c517ba22ecf64a4135faf5dd18701480457ca8fcb7900ff9bc91437066fba1f818aa59d0bc7d74af05ef5db4df69196e0c80d', 'id': '97a87809-dbc0-4758-993d-f63918679b2c', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97a87809-dbc0-4758-993d-f63918679b2c/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef2a9a9-d735-412c-b028-66c7349cadf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef2a9a9-d735-412c-b028-66c7349cadf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee52912-9cc4-4717-bbd6-721de3d7e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:31 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Volume 2935c39c-afe2-4513-a859-79e39b768fe9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2935c39c-afe2-4513-a859-79e39b768fe9', 'volume_size': 1, 'image_id': '97a87809-dbc0-4758-993d-f63918679b2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be6f2e640458184473df591a6874ec91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26c15cd37d504110a3dc97c49423b9c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58a22957efca458b28e982f8077c517ba22ecf64a4135faf5dd18701480457ca8fcb7900ff9bc91437066fba1f818aa59d0bc7d74af05ef5db4df69196e0c80d', 'id': '97a87809-dbc0-4758-993d-f63918679b2c', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97a87809-dbc0-4758-993d-f63918679b2c/file', 'properties': {}}, 'image_service': } Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Trying to clone 2935c39c-afe2-4513-a859-79e39b768fe9 from image 97a87809-dbc0-4758-993d-f63918679b2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 13:04:31 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 13:04:31 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Image download 0.00 MB at 0.00 MB/s Sep 02 13:04:31 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c Sep 02 13:04:31 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b02a34-67c6-4553-a2f6-71ea984fdfc5]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:31 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:31 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:31 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b 1073741824" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:31 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd.6c84962f-1cd0-4d0f-801b-abc036e36d5c" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b Sep 02 13:04:31 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-6c84962f-1cd0-4d0f-801b-abc036e36d5c" released by "_delete_snapshot" :: held 1.769s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" released by "delete_snapshot" :: held 1.818s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['97eaed83-2d08-4939-8035-ea77e2c5ab84', 'c56b903f-2d45-4a8f-9154-b0a1972f3a9e', 'b28307f3-c725-4b7d-bd2f-0c704a72efb6', 'd38b5beb-6d56-4300-9ac3-76198da132ca'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:31 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Delete snapshot completed successfully. Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a8ff712f-9187-47e4-a52b-52c7dc588065 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-6c84962f-1cd0-4d0f-801b-abc036e36d5c-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:32 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:32 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:32 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ec3b63-777e-4032-aa7c-eb201f74de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230b105b-51e2-4d2f-803d-be4b06f3926b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf00435-8275-4bca-b4ac-a16dd595bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Volume volume-230b105b-51e2-4d2f-803d-be4b06f3926b (230b105b-51e2-4d2f-803d-be4b06f3926b): created successfully Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf00435-8275-4bca-b4ac-a16dd595bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (b160edcf-b4f2-4704-93b3-53423933ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e6a28304-980c-4160-8f23-aebdf60cf454 tempest-ProjectReaderTests-553561828 None] Created volume successfully. Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-03fe894f-e736-4537-a7be-f92fcf4b61bd-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-0a2daaf8-b394-4517-b3a9-ef9132a91f6c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-0a2daaf8-b394-4517-b3a9-ef9132a91f6c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-03fe894f-e736-4537-a7be-f92fcf4b61bd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Temporary image 97a87809-dbc0-4758-993d-f63918679b2c is fetched for user 8d31e4841d6740e89d29cc8f5fc3633f. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5496ab-f103-4a09-9897-ddb911cef53b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1caa92e-fe53-497b-98d9-b54d223108e1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-230b105b-51e2-4d2f-803d-be4b06f3926b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fed7dae-cbeb-44de-b272-24b02eafd8e4]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "cinder-230b105b-51e2-4d2f-803d-be4b06f3926b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-quobyte-230b105b-51e2-4d2f-803d-be4b06f3926b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:32 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c Sep 02 13:04:32 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-230b105b-51e2-4d2f-803d-be4b06f3926b" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:32 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd Sep 02 13:04:32 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[64afff08-0fed-413b-8f1e-30e520b95c4c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:32 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b Sep 02 13:04:32 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:32 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd Sep 02 13:04:32 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:32 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c Sep 02 13:04:32 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:33 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b" returned: 0 in 0.447s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b Sep 02 13:04:33 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-03fe894f-e736-4537-a7be-f92fcf4b61bd" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-quobyte-03fe894f-e736-4537-a7be-f92fcf4b61bd" released by "delete_volume" :: held 0.832s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:33 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-0a2daaf8-b394-4517-b3a9-ef9132a91f6c" released by "delete_volume" :: held 0.885s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:33 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935c39c-afe2-4513-a859-79e39b768fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c15cd37d504110a3dc97c49423b9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:31Z,use_quota=True,user_id='8d31e4841d6740e89d29cc8f5fc3633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Creating volume 2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Created reservations ['64dd2ef7-8ba6-4a94-a6c9-058e893191f3', '07c7b58c-8bad-4388-a422-489974af0597', '2578ab20-db06-4f3f-9ea1-dacd8d37b6e6', '9fd28f34-8864-4182-a821-74630fdaf90c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:33 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1073741824 Sep 02 13:04:33 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['56595d35-3459-417a-ac04-573969cb0bd3', '9d07f4b8-ef0f-4079-8faa-b3d439aaf0af', 'b1e97fc7-691d-4083-b289-5d798d190628', '0b632bc9-a5eb-4819-a2b5-8c092bec9ac7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-230b105b-51e2-4d2f-803d-be4b06f3926b" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:33 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-230b105b-51e2-4d2f-803d-be4b06f3926b" released by "delete_volume" :: held 0.897s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:33 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Created reservations ['4260fecb-6c6e-4bf9-94f4-40fc6de0de7c', 'cd3ba8df-a98d-4fdf-878d-11fbc17a88fc', '94ec102d-8c90-4c81-9e54-695bc3feafe8', '60e9df70-a100-4363-9978-74d9c120e576'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:33 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:33 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Deleted volume successfully. Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-529ddec3-f158-4cd9-9a93-9fd5de628052 tempest-CreateVolumesFromSnapshotTest-1203578 None] Lock "cinder-03fe894f-e736-4537-a7be-f92fcf4b61bd-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:33 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:33 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0961886d-4925-4dd9-8603-6096e67d0357 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-0a2daaf8-b394-4517-b3a9-ef9132a91f6c-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1073741824" returned: 0 in 0.607s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:33 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Deleted volume successfully. Sep 02 13:04:34 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 Sep 02 13:04:34 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad9e19b9-4659-4054-b1b7-d68f8beaf808 tempest-ProjectReaderTests-553561828 None] Lock "cinder-230b105b-51e2-4d2f-803d-be4b06f3926b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:34 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (d2215ce7-57ba-43df-89c1-d635ffa8afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c528318-b07b-44ec-9fb8-0db2b2da0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Attempting download of 97a87809-dbc0-4758-993d-f63918679b2c ((None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}])) to volume 2935c39c-afe2-4513-a859-79e39b768fe9. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c528318-b07b-44ec-9fb8-0db2b2da0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214914041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7a0535-6efd-4129-89d8-3ccc4657e83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:34Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94310935-c398-4a38-81e7-4458ed974f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94310935-c398-4a38-81e7-4458ed974f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a89f48-f4df-484a-bd43-f5e290705cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a89f48-f4df-484a-bd43-f5e290705cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7a0535-6efd-4129-89d8-3ccc4657e83a', 'volume_name': 'volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494add62-07f8-4c00-b4b9-bcae6b89d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494add62-07f8-4c00-b4b9-bcae6b89d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77694a3-f44f-4554-8f29-5c4f3c802113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Volume 2f7a0535-6efd-4129-89d8-3ccc4657e83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a', 'volume_size': 1} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214914041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7a0535-6efd-4129-89d8-3ccc4657e83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:34Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Creating volume 2f7a0535-6efd-4129-89d8-3ccc4657e83a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:34 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:34 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a 1073741824 Sep 02 13:04:34 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[940485cc-72bb-43fe-8823-07527104e940]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-2a3c6939-30da-42e2-8cb8-462b4f8cda42-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-2a3c6939-30da-42e2-8cb8-462b4f8cda42-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:34 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w Sep 02 13:04:34 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-2a3c6939-30da-42e2-8cb8-462b4f8cda42" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-2a3c6939-30da-42e2-8cb8-462b4f8cda42" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0591f8-18d0-4c85-bccc-553ba00b01d6]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:34 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 Sep 02 13:04:34 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w" returned: 0 in 0.524s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:35 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a 1073741824" returned: 0 in 0.604s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:35 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a Sep 02 13:04:35 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w Sep 02 13:04:35 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:35 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42 Sep 02 13:04:35 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77694a3-f44f-4554-8f29-5c4f3c802113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ec874b-12e7-4d0d-b7c9-706a2ddb86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Volume volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a (2f7a0535-6efd-4129-89d8-3ccc4657e83a): created successfully Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ec874b-12e7-4d0d-b7c9-706a2ddb86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (d2215ce7-57ba-43df-89c1-d635ffa8afc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e84b816d-bc56-4003-9e65-836a5712338e tempest-ProjectReaderTests-553561828 None] Created volume successfully. Sep 02 13:04:35 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w" returned: 1 in 0.523s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97a87809-dbc0-4758-993d-f63918679b2c_ugswc69w' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7022a1cb-b42b-4690-b46d-2f86a61ddc08]: (4, 'raw') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:35 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2a3c6939-30da-42e2-8cb8-462b4f8cda42" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-2a3c6939-30da-42e2-8cb8-462b4f8cda42" released by "delete_volume" :: held 0.848s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['475e2ab9-a12f-41d6-93f3-bb301a1d1bd7', '94d63cf2-624d-4e91-8191-447fccab1db9', 'a00da77a-e20a-49f9-bc4d-0da8b85c91f8', '2bf040cc-cd85-458c-8eb7-c96642b6d357'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:35 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:35 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:35 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:35 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-7c63277c-1c9a-47dd-ba32-b90734c56363-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-7c63277c-1c9a-47dd-ba32-b90734c56363-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-7c63277c-1c9a-47dd-ba32-b90734c56363" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-7c63277c-1c9a-47dd-ba32-b90734c56363" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fb16ed-8590-41f3-b4f1-b9e7c510a5d7]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:36 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:36 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 Sep 02 13:04:36 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:36 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c50b171-4a27-4b69-88d8-380145f63af0 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-2a3c6939-30da-42e2-8cb8-462b4f8cda42-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:36 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD Sep 02 13:04:36 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:36 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD" returned: 1 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] 97a87809-dbc0-4758-993d-f63918679b2c was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:36 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:36 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 Sep 02 13:04:36 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-2f7a0535-6efd-4129-89d8-3ccc4657e83a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:36 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363 Sep 02 13:04:36 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "cinder-2f7a0535-6efd-4129-89d8-3ccc4657e83a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-quobyte-2f7a0535-6efd-4129-89d8-3ccc4657e83a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-2f7a0535-6efd-4129-89d8-3ccc4657e83a" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240b670-5495-4dc0-9a5c-bf4b32af554e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:36 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c63277c-1c9a-47dd-ba32-b90734c56363" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-7c63277c-1c9a-47dd-ba32-b90734c56363" released by "delete_volume" :: held 0.907s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:36 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a Sep 02 13:04:36 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:36 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['8255b239-6b53-4f84-943a-83aa84c9ee38', 'cda6a05e-a397-430a-9ab9-0a4601a5b6db', 'd35243b5-fb0f-4718-aa09-fe5595cdab97', '4b6e8338-8eae-4260-bf99-54c8cd0b6b7e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:37 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:37 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-98a48559-5fd1-41a8-9f0e-562e13441430-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-98a48559-5fd1-41a8-9f0e-562e13441430-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-98a48559-5fd1-41a8-9f0e-562e13441430" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-98a48559-5fd1-41a8-9f0e-562e13441430" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:37 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9" returned: 0 in 0.791s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a" returned: 0 in 0.583s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97a87809-dbc0-4758-993d-f63918679b2c_wnomraqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:04:37 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca6af5-b47d-4600-bc54-406ff86c8d4b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:37 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a Sep 02 13:04:37 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:37 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1G Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:04:37 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:37 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:37 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:37 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:37 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 Sep 02 13:04:37 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d951928d-e34c-41d8-98a7-84abd0aecada tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-7c63277c-1c9a-47dd-ba32-b90734c56363-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:37 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2f7a0535-6efd-4129-89d8-3ccc4657e83a" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-2f7a0535-6efd-4129-89d8-3ccc4657e83a" released by "delete_volume" :: held 1.055s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:37 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 1G" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Downloaded image 97a87809-dbc0-4758-993d-f63918679b2c ((None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}])) to volume 2935c39c-afe2-4513-a859-79e39b768fe9 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Temporary image 97a87809-dbc0-4758-993d-f63918679b2c for user 8d31e4841d6740e89d29cc8f5fc3633f is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Marking volume 2935c39c-afe2-4513-a859-79e39b768fe9 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 13:04:37 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Created reservations ['57ca4820-6caa-4a7f-bfd9-86aff1283256', 'bb089b8c-da49-4fe5-b678-a97e11875dd1', '03ee70bc-6e32-411f-b911-b912a4e49db9', '94b47f22-1361-424f-91ec-f15fe3e5f7d8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Copying metadata from image 97a87809-dbc0-4758-993d-f63918679b2c to 2935c39c-afe2-4513-a859-79e39b768fe9. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Creating volume glance metadata for volume 2935c39c-afe2-4513-a859-79e39b768fe9 backed by image 97a87809-dbc0-4758-993d-f63918679b2c with: {'image_id': '97a87809-dbc0-4758-993d-f63918679b2c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be6f2e640458184473df591a6874ec91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 13:04:37 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430" returned: 0 in 0.664s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:38 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:38 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee52912-9cc4-4717-bbd6-721de3d7e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2935c39c-afe2-4513-a859-79e39b768fe9', 'volume_size': 1, 'image_id': '97a87809-dbc0-4758-993d-f63918679b2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97a87809-dbc0-4758-993d-f63918679b2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be6f2e640458184473df591a6874ec91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26c15cd37d504110a3dc97c49423b9c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58a22957efca458b28e982f8077c517ba22ecf64a4135faf5dd18701480457ca8fcb7900ff9bc91437066fba1f818aa59d0bc7d74af05ef5db4df69196e0c80d', 'id': '97a87809-dbc0-4758-993d-f63918679b2c', 'created_at': datetime.datetime(2026, 9, 2, 11, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 2, 11, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97a87809-dbc0-4758-993d-f63918679b2c/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430 Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026a3b7d-7b68-49d6-8867-c819466a0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Volume volume-2935c39c-afe2-4513-a859-79e39b768fe9 (2935c39c-afe2-4513-a859-79e39b768fe9): created successfully Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026a3b7d-7b68-49d6-8867-c819466a0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Flow 'volume_create_manager' (fbc01015-aced-45ad-9817-5074ba59c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b53f2570-335f-4534-ba2c-780bfdb5a56d tempest-VolumeImageDependencyTests-1193745691 None] Created volume successfully. Sep 02 13:04:38 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-98a48559-5fd1-41a8-9f0e-562e13441430" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:38 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.317s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-98a48559-5fd1-41a8-9f0e-562e13441430" released by "delete_volume" :: held 1.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Deleted volume successfully. Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-600c3180-61fc-41e2-a33c-f6de31543f76 tempest-ProjectReaderTests-553561828 None] Lock "cinder-2f7a0535-6efd-4129-89d8-3ccc4657e83a-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['375fb95c-87c0-457f-aa39-c1f4e525d647', 'fbf6db6e-f7f7-49c2-ac40-4fe2abddb932', 'dd853410-b289-4789-a4a8-2ab187fd7c8e', '2e73f395-13b1-4715-bfce-817aab66db35'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:38 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:38 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Flow 'volume_create_manager' (6c864033-d0a8-4445-a7d5-b925573ca0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068b24f9-6378-448f-93ca-c3eed508f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Acquiring lock "cinder-2935c39c-afe2-4513-a859-79e39b768fe9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068b24f9-6378-448f-93ca-c3eed508f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa21c2a1-740a-43ed-ab00-528dff710b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aab788a61042219375d7882a61977d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:39Z,use_quota=True,user_id='5a8a6b6853194c43a799762a66894184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832d0bd7-14ba-4aca-b84c-e853b87a802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832d0bd7-14ba-4aca-b84c-e853b87a802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f740508-ae20-495e-bd5c-7e2ce4132d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f740508-ae20-495e-bd5c-7e2ce4132d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa21c2a1-740a-43ed-ab00-528dff710b80', 'volume_name': 'volume-fa21c2a1-740a-43ed-ab00-528dff710b80', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf5cea3-b772-4de7-af87-cf94b65dc748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf5cea3-b772-4de7-af87-cf94b65dc748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7799dfba-96b8-4463-8576-3534954fa874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Volume fa21c2a1-740a-43ed-ab00-528dff710b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa21c2a1-740a-43ed-ab00-528dff710b80', 'volume_size': 1} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa21c2a1-740a-43ed-ab00-528dff710b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aab788a61042219375d7882a61977d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:39Z,use_quota=True,user_id='5a8a6b6853194c43a799762a66894184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Creating volume fa21c2a1-740a-43ed-ab00-528dff710b80 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "cinder-2935c39c-afe2-4513-a859-79e39b768fe9-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:38 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 1073741824 Sep 02 13:04:38 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Acquiring lock "cinder-quobyte-2935c39c-afe2-4513-a859-79e39b768fe9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:38 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "cinder-quobyte-2935c39c-afe2-4513-a859-79e39b768fe9" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4012c287-9405-4c33-9f18-52c46d354def tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-98a48559-5fd1-41a8-9f0e-562e13441430-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a90503f-05a9-4833-be2f-2bb52f52385e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:38 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 Sep 02 13:04:38 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:39 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 1073741824" returned: 0 in 0.574s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:39 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:39 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9 Sep 02 13:04:39 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:39 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 Sep 02 13:04:39 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (87660dcb-f5cc-482b-aaf0-ef2e169a8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd410e2-1ea9-4318-9120-cc62ae98ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd410e2-1ea9-4318-9120-cc62ae98ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061902899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887c9af5-a437-48bc-85a3-27b5c6c286c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:39Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473861d0-e077-4b1b-b935-7f666541ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473861d0-e077-4b1b-b935-7f666541ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dca6e0-d968-4fc1-b546-088bcfbcd992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dca6e0-d968-4fc1-b546-088bcfbcd992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887c9af5-a437-48bc-85a3-27b5c6c286c6', 'volume_name': 'volume-887c9af5-a437-48bc-85a3-27b5c6c286c6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77428696-956e-4af1-95e3-384a8e3b2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77428696-956e-4af1-95e3-384a8e3b2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eea6392-2874-4355-8420-7c695f08a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Volume 887c9af5-a437-48bc-85a3-27b5c6c286c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887c9af5-a437-48bc-85a3-27b5c6c286c6', 'volume_size': 1} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-7c0df139-d6b0-47a9-9707-7c9ca28e629a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-7c0df139-d6b0-47a9-9707-7c9ca28e629a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:39 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-7c0df139-d6b0-47a9-9707-7c9ca28e629a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:39 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2935c39c-afe2-4513-a859-79e39b768fe9" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "cinder-quobyte-2935c39c-afe2-4513-a859-79e39b768fe9" released by "delete_volume" :: held 0.833s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-7c0df139-d6b0-47a9-9707-7c9ca28e629a" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061902899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887c9af5-a437-48bc-85a3-27b5c6c286c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54192cc92db41c99c6c1bdec5669dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:39Z,use_quota=True,user_id='4a4983d61b014670939e80b098a3376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Creating volume 887c9af5-a437-48bc-85a3-27b5c6c286c6 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc8625-9287-4ec9-b9b0-ed94385bb5d2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:39 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 1073741824 Sep 02 13:04:39 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7799dfba-96b8-4463-8576-3534954fa874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa21c2a1-740a-43ed-ab00-528dff710b80', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fb3604-46bb-4907-9e96-628617e921e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Volume volume-fa21c2a1-740a-43ed-ab00-528dff710b80 (fa21c2a1-740a-43ed-ab00-528dff710b80): created successfully Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fb3604-46bb-4907-9e96-628617e921e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Flow 'volume_create_manager' (6c864033-d0a8-4445-a7d5-b925573ca0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-821e85d0-1a2a-4d1a-8f98-1152a80ca502 tempest-CinderUnicodeTest-489037452 None] Created volume successfully. Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Created reservations ['660659aa-08ba-4859-a91b-f61b175620f6', '53bf18e0-3756-4454-8baf-61b0337709e4', 'd352affe-8913-4c44-be27-e481a302c631', 'c16398a5-19fd-4abe-a2c8-cd0b6bbc43bf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:39 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a Sep 02 13:04:39 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:39 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:39 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:40 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:40 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 1073741824" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:40 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a Sep 02 13:04:40 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Deleted volume successfully. Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f00f1718-1df8-416f-aa9b-d72e834629c2 tempest-VolumeImageDependencyTests-1193745691 None] Lock "cinder-2935c39c-afe2-4513-a859-79e39b768fe9-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:40 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 Sep 02 13:04:40 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:40 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7c0df139-d6b0-47a9-9707-7c9ca28e629a" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-7c0df139-d6b0-47a9-9707-7c9ca28e629a" released by "delete_volume" :: held 0.824s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['81331816-ad24-486b-84cc-f4846b8d4963', '6c54420d-aff3-414b-90e2-90e29c627b6a', 'e117c67d-bffc-445c-b314-a8662ccffa95', '22ec99d1-7c3b-4b4f-9d7d-707a666c7548'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:40 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eea6392-2874-4355-8420-7c695f08a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887c9af5-a437-48bc-85a3-27b5c6c286c6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34dab7-1518-458a-9e16-2028270e7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Volume volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 (887c9af5-a437-48bc-85a3-27b5c6c286c6): created successfully Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab34dab7-1518-458a-9e16-2028270e7427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Flow 'volume_create_manager' (87660dcb-f5cc-482b-aaf0-ef2e169a8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-da359ce0-2f4a-4fbc-bb4f-b5e943b62f11 tempest-ProjectReaderTests-553561828 None] Created volume successfully. Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:40 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:40 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-73425ae3-b63e-47c5-adbb-f1018dcb7cad-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-73425ae3-b63e-47c5-adbb-f1018dcb7cad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "cinder-quobyte-73425ae3-b63e-47c5-adbb-f1018dcb7cad" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-73425ae3-b63e-47c5-adbb-f1018dcb7cad" acquired by "delete_volume" :: waited 0.051s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c80b6-85f1-4e0c-9bc6-a851921f0cea]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:40 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-583f97a7-ed8c-4c95-9922-f864cc1d2e42 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-7c0df139-d6b0-47a9-9707-7c9ca28e629a-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:41 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad Sep 02 13:04:41 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Flow 'volume_create_manager' (6d5e8dba-a55c-45ea-9176-4a41c3c3088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8188378-3fd7-4f35-b8fd-fcc793e47bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8188378-3fd7-4f35-b8fd-fcc793e47bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-483246219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21314b38-0881-4a0d-98b7-8127974d89ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aab788a61042219375d7882a61977d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:41Z,use_quota=True,user_id='5a8a6b6853194c43a799762a66894184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcac41af-28f0-4f8c-800a-1e8d341c7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcac41af-28f0-4f8c-800a-1e8d341c7804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be9538-1abc-44d1-b8b2-1bf31f1dce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be9538-1abc-44d1-b8b2-1bf31f1dce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21314b38-0881-4a0d-98b7-8127974d89ba', 'volume_name': 'volume-21314b38-0881-4a0d-98b7-8127974d89ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:41 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f851c78f-bd88-49c4-89f2-9a77967aaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f851c78f-bd88-49c4-89f2-9a77967aaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df9bdd3-e15f-49ef-9ca2-0f35e5972b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Volume 21314b38-0881-4a0d-98b7-8127974d89ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21314b38-0881-4a0d-98b7-8127974d89ba', 'volume_size': 1} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-483246219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21314b38-0881-4a0d-98b7-8127974d89ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aab788a61042219375d7882a61977d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:41Z,use_quota=True,user_id='5a8a6b6853194c43a799762a66894184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Creating volume 21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:41 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad" returned: 0 in 0.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:41 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba 1073741824 Sep 02 13:04:41 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:41 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad Sep 02 13:04:41 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-887c9af5-a437-48bc-85a3-27b5c6c286c6-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "cinder-887c9af5-a437-48bc-85a3-27b5c6c286c6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Acquiring lock "cinder-quobyte-887c9af5-a437-48bc-85a3-27b5c6c286c6" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-887c9af5-a437-48bc-85a3-27b5c6c286c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb8feae-9ce8-46b4-8b68-e3e4f0d9bc4a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:41 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-73425ae3-b63e-47c5-adbb-f1018dcb7cad" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-quobyte-73425ae3-b63e-47c5-adbb-f1018dcb7cad" released by "delete_volume" :: held 0.927s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:41 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 Sep 02 13:04:41 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Created reservations ['6004734c-6f81-4dc9-8f49-991658b25a88', 'a35dcc8b-1ad3-47d3-b69f-9cf9c03db34b', '2e87560a-ec5a-43a3-8f97-d9fa1d16c15e', 'd5e7d32c-23e9-4d35-b974-841eaa9ee907'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:42 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba 1073741824" returned: 0 in 0.601s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:42 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:42 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:42 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba Sep 02 13:04:42 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:42 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6" returned: 0 in 0.494s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:42 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6 Sep 02 13:04:42 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:42 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Deleted volume successfully. Sep 02 13:04:42 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-073fac3a-5b4d-4a72-a483-04a7cd6ed1e2 tempest-CreateVolumesFromSourceVolumeTest-1109919196 None] Lock "cinder-73425ae3-b63e-47c5-adbb-f1018dcb7cad-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba" returned: 0 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df9bdd3-e15f-49ef-9ca2-0f35e5972b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21314b38-0881-4a0d-98b7-8127974d89ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35265be9-4218-4eea-b1ba-292d0bb76c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Volume volume-21314b38-0881-4a0d-98b7-8127974d89ba (21314b38-0881-4a0d-98b7-8127974d89ba): created successfully Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35265be9-4218-4eea-b1ba-292d0bb76c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Flow 'volume_create_manager' (6d5e8dba-a55c-45ea-9176-4a41c3c3088a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-381031bb-2fa6-4d07-b3ca-2b0292f68ce1 tempest-CinderUnicodeTest-489037452 None] Created volume successfully. Sep 02 13:04:42 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-887c9af5-a437-48bc-85a3-27b5c6c286c6" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "cinder-quobyte-887c9af5-a437-48bc-85a3-27b5c6c286c6" released by "delete_volume" :: held 0.963s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Created reservations ['69da8b2e-f585-439f-a926-6ddd2992ab40', '3db1658f-1be2-4be6-ac37-3b7521a59f8e', '537ec196-d7c9-41b5-95ea-fdd94a40e2e7', '0157b2da-b777-4044-bcec-c2bccfa2fb11'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:42 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:42 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:43 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Deleted volume successfully. Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-412a6595-66c2-4992-92fd-ae6ab6a59e93 tempest-ProjectReaderTests-553561828 None] Lock "cinder-887c9af5-a437-48bc-85a3-27b5c6c286c6-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Creating offline snapshot d3586ec6-be95-4b57-afff-f4fa309abca4 of volume 21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a9b5d-50ca-45fe-995d-e4000678c8be]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:43 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba Sep 02 13:04:43 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:44 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba" returned: 0 in 0.505s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:44 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 1G Sep 02 13:04:44 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:44 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 1G" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21314b38-0881-4a0d-98b7-8127974d89ba -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:44 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21314b38-0881-4a0d-98b7-8127974d89ba -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 Sep 02 13:04:44 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:45 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21314b38-0881-4a0d-98b7-8127974d89ba -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 is being set with open permissions: ugo+rw Sep 02 13:04:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:45 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 Sep 02 13:04:45 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:45 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:45 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info Sep 02 13:04:45 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:45 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:46 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info is being set with open permissions: ugo+rw Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:46 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info Sep 02 13:04:46 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Flow 'volume_create_manager' (9db20d05-176e-4b8e-b8f1-0703ace29e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747b18b6-06b9-4c4e-b5e0-33319aa98614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747b18b6-06b9-4c4e-b5e0-33319aa98614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279124535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beec7e59-a47c-407e-9a47-7da8e235dfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e8dd8ac6f461d9b10522ccc9cd293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:46Z,use_quota=True,user_id='10ce4d769853427ea93d98c799002ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92ac1a1-33fb-473b-b72d-93ee66abea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92ac1a1-33fb-473b-b72d-93ee66abea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb9a3e2-5ac8-4168-808d-64a1443b6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb9a3e2-5ac8-4168-808d-64a1443b6a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beec7e59-a47c-407e-9a47-7da8e235dfdb', 'volume_name': 'volume-beec7e59-a47c-407e-9a47-7da8e235dfdb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:46 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab563b3-bb02-4001-a315-b83a3484967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab563b3-bb02-4001-a315-b83a3484967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515915ee-a484-473f-b99d-98b2ea27dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Volume beec7e59-a47c-407e-9a47-7da8e235dfdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beec7e59-a47c-407e-9a47-7da8e235dfdb', 'volume_size': 1} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.info" returned: 0 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279124535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beec7e59-a47c-407e-9a47-7da8e235dfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e8dd8ac6f461d9b10522ccc9cd293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:46Z,use_quota=True,user_id='10ce4d769853427ea93d98c799002ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Creating volume beec7e59-a47c-407e-9a47-7da8e235dfdb {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:46 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:46 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb 1073741824 Sep 02 13:04:46 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d917514-b733-4b4c-839f-2f7a79897871 tempest-CinderUnicodeTest-489037452 None] Create snapshot completed successfully Sep 02 13:04:46 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb 1073741824" returned: 0 in 0.519s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-d3586ec6-be95-4b57-afff-f4fa309abca4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-d3586ec6-be95-4b57-afff-f4fa309abca4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:47 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb Sep 02 13:04:47 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Flow 'volume_create_manager' (a66884f0-91ca-48b2-817c-cd8836ad85c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c55bd-ceee-4323-9e1a-91c995f9838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-quobyte-d3586ec6-be95-4b57-afff-f4fa309abca4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c55bd-ceee-4323-9e1a-91c995f9838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1274639046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea66acca-64f5-4ae4-8606-81078409ec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b54e9ce95e4e4b8e75d0acf80d3bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:47Z,use_quota=True,user_id='ec510f57d78c4119a1f0baa9d7893423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6190234-61e4-4daa-9404-6b7f3a83972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6190234-61e4-4daa-9404-6b7f3a83972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6ce74b-56ed-4a57-bfee-d184bfb6400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6ce74b-56ed-4a57-bfee-d184bfb6400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea66acca-64f5-4ae4-8606-81078409ec60', 'volume_name': 'volume-ea66acca-64f5-4ae4-8606-81078409ec60', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06330aa-676a-4548-ac7c-2aadacba8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06330aa-676a-4548-ac7c-2aadacba8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05ed6c-917d-49e2-93c8-7f5492e226f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Volume ea66acca-64f5-4ae4-8606-81078409ec60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea66acca-64f5-4ae4-8606-81078409ec60', 'volume_size': 1} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-d3586ec6-be95-4b57-afff-f4fa309abca4" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Deleting offline snapshot d3586ec6-be95-4b57-afff-f4fa309abca4 of volume 21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] snapshot_file for this snap is: volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e66eb0-94c7-46f2-a95e-decdf5883f1d]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:47 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1274639046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea66acca-64f5-4ae4-8606-81078409ec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b54e9ce95e4e4b8e75d0acf80d3bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:47Z,use_quota=True,user_id='ec510f57d78c4119a1f0baa9d7893423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Creating volume ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:47 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 Sep 02 13:04:47 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515915ee-a484-473f-b99d-98b2ea27dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beec7e59-a47c-407e-9a47-7da8e235dfdb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bc88d7-379a-4c78-93eb-af7068c1098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:47 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 1073741824 Sep 02 13:04:47 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Volume volume-beec7e59-a47c-407e-9a47-7da8e235dfdb (beec7e59-a47c-407e-9a47-7da8e235dfdb): created successfully Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bc88d7-379a-4c78-93eb-af7068c1098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Flow 'volume_create_manager' (9db20d05-176e-4b8e-b8f1-0703ace29e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7d657a75-7446-4b13-92e2-92606cd3781c tempest-ProjectReaderTests-1662749252 None] Created volume successfully. Sep 02 13:04:47 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21314b38-0881-4a0d-98b7-8127974d89ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cacc22-0560-474b-a019-e585c06c9521]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:47 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba Sep 02 13:04:47 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:47 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 1073741824" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:47 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:04:47 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:47 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:47 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:47 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 Sep 02 13:04:47 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05ed6c-917d-49e2-93c8-7f5492e226f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea66acca-64f5-4ae4-8606-81078409ec60', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61031b06-ff8c-4e73-8cc2-7382d0ca1566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Volume volume-ea66acca-64f5-4ae4-8606-81078409ec60 (ea66acca-64f5-4ae4-8606-81078409ec60): created successfully Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61031b06-ff8c-4e73-8cc2-7382d0ca1566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Flow 'volume_create_manager' (a66884f0-91ca-48b2-817c-cd8836ad85c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-95ce097a-fd34-4f0a-a8c7-684eb3c516cb tempest-VolumeDependencyTests-1312159790 None] Created volume successfully. Sep 02 13:04:48 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:48 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4 Sep 02 13:04:48 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "cinder-beec7e59-a47c-407e-9a47-7da8e235dfdb-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:48 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba.d3586ec6-be95-4b57-afff-f4fa309abca4" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-beec7e59-a47c-407e-9a47-7da8e235dfdb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-d3586ec6-be95-4b57-afff-f4fa309abca4" released by "_delete_snapshot" :: held 1.531s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" released by "delete_snapshot" :: held 1.595s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "cinder-quobyte-beec7e59-a47c-407e-9a47-7da8e235dfdb" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-quobyte-beec7e59-a47c-407e-9a47-7da8e235dfdb" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aa3cf4-a810-4869-9bc8-1cb13815d4d0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Created reservations ['1c5508a9-2247-4854-8784-c0b0eae0e422', 'b6cbf54f-6d9d-4a6d-b07b-d499daf1dc08', 'e28f91f7-61a8-4be1-b76a-6aa26b294f63', '423b1e29-4054-4aac-bc78-dab0ed59a428'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Delete snapshot completed successfully. Sep 02 13:04:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edf8369b-799c-4301-a57d-6386a598dd18 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-d3586ec6-be95-4b57-afff-f4fa309abca4-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:48 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb Sep 02 13:04:48 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb" returned: 0 in 0.397s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-21314b38-0881-4a0d-98b7-8127974d89ba-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-21314b38-0881-4a0d-98b7-8127974d89ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:49 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb Sep 02 13:04:49 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550c62b-482d-4fb4-b53c-c5c19f82072e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Creating offline snapshot 46d83fb5-f845-4748-af37-f14260ec87e3 of volume ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8c510-1adc-40f9-8afb-74574c5c4f56]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba Sep 02 13:04:49 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:04:49 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-beec7e59-a47c-407e-9a47-7da8e235dfdb" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-quobyte-beec7e59-a47c-407e-9a47-7da8e235dfdb" released by "delete_volume" :: held 0.802s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Created reservations ['b3f00e2f-64b0-426e-8836-35f34738c713', '7fd5cdb3-d1de-4262-a56a-362c1c0a5802', '36fec8e4-1a11-4d82-b093-7e29a54bc3f2', 'd1419c9e-a754-4ecd-a216-add88bf9e8ae'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:49 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba Sep 02 13:04:49 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:49 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 1G Sep 02 13:04:49 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:49 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Deleted volume successfully. Sep 02 13:04:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f8698b1-a766-4c03-9e2b-85ec2e65bb65 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-beec7e59-a47c-407e-9a47-7da8e235dfdb-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:50 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-21314b38-0881-4a0d-98b7-8127974d89ba" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-21314b38-0881-4a0d-98b7-8127974d89ba" released by "delete_volume" :: held 0.838s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Created reservations ['068ef9cf-eb2d-40b2-82ff-5ccc2b1ab5bd', 'e5fd7cce-e5da-4b43-bcfa-8cb9e440b719', '5504b737-2dd9-441c-bc43-b4d68dafd6e4', '31d85555-bbd3-4805-81e2-ced97f4adac1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-fa21c2a1-740a-43ed-ab00-528dff710b80-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "cinder-fa21c2a1-740a-43ed-ab00-528dff710b80-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:50 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:50 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:50 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Flow 'volume_create_manager' (f0a0943d-c99e-47b7-9af3-a8babde4f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f31a86-7a51-4c72-b91f-12064f359cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 1G" returned: 0 in 0.670s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea66acca-64f5-4ae4-8606-81078409ec60 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f31a86-7a51-4c72-b91f-12064f359cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325885316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89141d6f-c8d2-42b8-84d3-e3ad10021954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e8dd8ac6f461d9b10522ccc9cd293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:50Z,use_quota=True,user_id='10ce4d769853427ea93d98c799002ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:50 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea66acca-64f5-4ae4-8606-81078409ec60 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cd7f1b-f63f-4d14-ab00-6be07035451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:50 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cd7f1b-f63f-4d14-ab00-6be07035451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d5d5e9-f2d8-453c-aa95-67f681e452f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d5d5e9-f2d8-453c-aa95-67f681e452f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89141d6f-c8d2-42b8-84d3-e3ad10021954', 'volume_name': 'volume-89141d6f-c8d2-42b8-84d3-e3ad10021954', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802c505-dd5b-4a80-8523-da06bb0ebd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802c505-dd5b-4a80-8523-da06bb0ebd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a96f85-bee9-46bf-87a5-952db7db1281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Volume 89141d6f-c8d2-42b8-84d3-e3ad10021954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89141d6f-c8d2-42b8-84d3-e3ad10021954', 'volume_size': 1} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Acquiring lock "cinder-quobyte-fa21c2a1-740a-43ed-ab00-528dff710b80" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-fa21c2a1-740a-43ed-ab00-528dff710b80" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8baa69-c4cd-4077-99c9-49a8ac026b1c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:50 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Deleted volume successfully. Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96e698ee-abc5-4cf8-81ad-82d697a12cf1 tempest-CinderUnicodeTest-489037452 None] Lock "cinder-21314b38-0881-4a0d-98b7-8127974d89ba-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:50 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 Sep 02 13:04:50 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:50 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea66acca-64f5-4ae4-8606-81078409ec60 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:50 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 is being set with open permissions: ugo+rw Sep 02 13:04:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:50 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:04:50 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:50 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:51 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80 Sep 02 13:04:51 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:51 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:51 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info Sep 02 13:04:51 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:51 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-fa21c2a1-740a-43ed-ab00-528dff710b80" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "cinder-quobyte-fa21c2a1-740a-43ed-ab00-528dff710b80" released by "delete_volume" :: held 0.728s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Created reservations ['3e743d09-3f45-4d61-8aa8-2e094d26c7bf', 'a69bfacd-c250-4dc2-abbf-f11fa2ec696d', '69f91848-2040-4234-b2c2-96ec169fdf03', '04a9a8be-08db-4151-9151-d36a74a23fa4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:51 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info is being set with open permissions: ugo+rw Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:51 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info Sep 02 13:04:51 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:51 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:51 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:51 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.info" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325885316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89141d6f-c8d2-42b8-84d3-e3ad10021954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e8dd8ac6f461d9b10522ccc9cd293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:50Z,use_quota=True,user_id='10ce4d769853427ea93d98c799002ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Creating volume 89141d6f-c8d2-42b8-84d3-e3ad10021954 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:51 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:51 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 1073741824 Sep 02 13:04:51 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Deleted volume successfully. Sep 02 13:04:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-889da63f-674a-48f5-962e-5e810e7e789c tempest-VolumeDependencyTests-1312159790 None] Create snapshot completed successfully Sep 02 13:04:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b3ec53f5-ef68-49ed-830f-d4067903a06a tempest-CinderUnicodeTest-489037452 None] Lock "cinder-fa21c2a1-740a-43ed-ab00-528dff710b80-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:52 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 1073741824" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:52 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 Sep 02 13:04:52 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:52 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a96f85-bee9-46bf-87a5-952db7db1281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89141d6f-c8d2-42b8-84d3-e3ad10021954', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09f06b1-0f34-4ccc-bbe7-b06940ea0a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Volume volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 (89141d6f-c8d2-42b8-84d3-e3ad10021954): created successfully Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09f06b1-0f34-4ccc-bbe7-b06940ea0a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Flow 'volume_create_manager' (f0a0943d-c99e-47b7-9af3-a8babde4f90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-afaa5b36-2e74-40ff-b1d9-2373bac06c3b tempest-ProjectReaderTests-1662749252 None] Created volume successfully. Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Flow 'volume_create_manager' (087cbf6f-6267-4dd0-9e0e-eadff0531a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fee26a-fb51-4f21-b51a-933bb85d27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fee26a-fb51-4f21-b51a-933bb85d27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-625807841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cefe0d3a-85ae-4368-9b65-0425f914b780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b54e9ce95e4e4b8e75d0acf80d3bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46d83fb5-f845-4748-af37-f14260ec87e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:04:53Z,use_quota=True,user_id='ec510f57d78c4119a1f0baa9d7893423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d418ace1-2abf-4a73-9641-8f7bcf4c3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d418ace1-2abf-4a73-9641-8f7bcf4c3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a4ab2b-03ca-4a8e-8394-2b16138b6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a4ab2b-03ca-4a8e-8394-2b16138b6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cefe0d3a-85ae-4368-9b65-0425f914b780', 'volume_name': 'volume-cefe0d3a-85ae-4368-9b65-0425f914b780', 'volume_size': 1, 'snapshot_id': '46d83fb5-f845-4748-af37-f14260ec87e3'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72ef800-8214-42af-b4a7-b6f0d81d96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72ef800-8214-42af-b4a7-b6f0d81d96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f96b25-abb8-4129-93cd-d0ea37084b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:04:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Volume cefe0d3a-85ae-4368-9b65-0425f914b780: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cefe0d3a-85ae-4368-9b65-0425f914b780', 'volume_size': 1, 'snapshot_id': '46d83fb5-f845-4748-af37-f14260ec87e3'} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3-cefe0d3a-85ae-4368-9b65-0425f914b780" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3-cefe0d3a-85ae-4368-9b65-0425f914b780" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Creating volume cefe0d3a-85ae-4368-9b65-0425f914b780 from snapshot 46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] snapshot: 46d83fb5-f845-4748-af37-f14260ec87e3, volume: cefe0d3a-85ae-4368-9b65-0425f914b780, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[353cc0bc-7c5d-4aca-b577-f8b20b47d092]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:53 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:04:53 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "cinder-89141d6f-c8d2-42b8-84d3-e3ad10021954-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-89141d6f-c8d2-42b8-84d3-e3ad10021954-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "cinder-quobyte-89141d6f-c8d2-42b8-84d3-e3ad10021954" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-quobyte-89141d6f-c8d2-42b8-84d3-e3ad10021954" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ad981-7c7d-4ed8-b728-5084dae4e36e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:53 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.461s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea66acca-64f5-4ae4-8606-81078409ec60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:04:53 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 Sep 02 13:04:53 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da00c6a-cb4b-4f7e-b177-a9d6e365188a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:04:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:53 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:04:53 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:54 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954 Sep 02 13:04:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:54 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:54 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 Sep 02 13:04:54 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:54 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-89141d6f-c8d2-42b8-84d3-e3ad10021954" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-quobyte-89141d6f-c8d2-42b8-84d3-e3ad10021954" released by "delete_volume" :: held 0.714s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Created reservations ['afb88976-4e0d-434c-8325-9fe624d0d9f4', 'ff270c1f-4f7d-4eb0-81fd-43e032185d06', '3acfec90-a690-46e5-afc5-97197dbfaa34', 'a5ec0ed7-24dc-4890-af26-a63d1a613647'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:54 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:04:54 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:04:54 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:04:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Deleted volume successfully. Sep 02 13:04:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51efbc5a-931f-4f93-a3e7-c8cbae7c5dd9 tempest-ProjectReaderTests-1662749252 None] Lock "cinder-89141d6f-c8d2-42b8-84d3-e3ad10021954-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:04:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-924d88fe-bb9f-4990-8109-529b1a5974cc tempest-ProjectAdminTests-395109158 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.881504058838, 'free_capacity_gb': 1773.881504058838, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 13:04:59 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 02 13:04:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780" returned: 0 in 5.609s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:04:59 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:04:59 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Converted 1024.00 MB image at 182.52 MB/s Sep 02 13:04:59 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 is being set with open permissions: ugo+rw Sep 02 13:04:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:04:59 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 Sep 02 13:04:59 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:00 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" released by "_copy_volume_from_snapshot" :: held 6.862s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=235,cinder:INSERT=85,cinder:UPDATE=312,cinder:DELETE=30 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=327,cinder:SELECT=218,cinder:DELETE=28,cinder:INSERT=81 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3-cefe0d3a-85ae-4368-9b65-0425f914b780" released by "_create_volume_from_snapshot" :: held 6.949s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.973s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f96b25-abb8-4129-93cd-d0ea37084b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cefe0d3a-85ae-4368-9b65-0425f914b780', 'volume_size': 1, 'snapshot_id': '46d83fb5-f845-4748-af37-f14260ec87e3'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f823ae-a480-4d1b-9768-4705f4ae591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Volume volume-cefe0d3a-85ae-4368-9b65-0425f914b780 (cefe0d3a-85ae-4368-9b65-0425f914b780): created successfully Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f823ae-a480-4d1b-9768-4705f4ae591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Flow 'volume_create_manager' (087cbf6f-6267-4dd0-9e0e-eadff0531a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4645a79d-c319-43a3-a81e-77e9b6d04f23 tempest-VolumeDependencyTests-1312159790 None] Created volume successfully. Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-46d83fb5-f845-4748-af37-f14260ec87e3-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-46d83fb5-f845-4748-af37-f14260ec87e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Deleting offline snapshot 46d83fb5-f845-4748-af37-f14260ec87e3 of volume ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] snapshot_file for this snap is: volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1344c4-9aff-4b36-b69c-b5d63fe45760]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:01 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:05:01 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:01 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea66acca-64f5-4ae4-8606-81078409ec60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58cd48a-1e90-49c0-8c26-7e5ad698750a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:01 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:05:01 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:02 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.620s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:02 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:05:02 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:02 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:02 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3 Sep 02 13:05:02 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:02 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60.46d83fb5-f845-4748-af37-f14260ec87e3" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-46d83fb5-f845-4748-af37-f14260ec87e3" released by "_delete_snapshot" :: held 1.929s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" released by "delete_snapshot" :: held 1.959s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Created reservations ['9ddb7c5c-fb9a-49a5-882e-1294fb1ac818', '52d725fd-0054-4ba9-b45d-fb5b00707081', 'ec67024d-b5c4-491b-9bf7-fc99da58c6a6', '2d46c9ae-4c5e-402c-85fa-052fbce12d2d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Delete snapshot completed successfully. Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0ec097d-070e-44df-aa34-5df8a1c8a378 tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-46d83fb5-f845-4748-af37-f14260ec87e3-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-ea66acca-64f5-4ae4-8606-81078409ec60-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-ea66acca-64f5-4ae4-8606-81078409ec60-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[80206136-0524-43f3-a957-9d1802ea4986]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:03 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:05:03 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:03 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:03 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60 Sep 02 13:05:03 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:04 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-ea66acca-64f5-4ae4-8606-81078409ec60" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-ea66acca-64f5-4ae4-8606-81078409ec60" released by "delete_volume" :: held 0.764s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Created reservations ['237431ea-374e-4f74-a1e4-8c4adf75b5e7', '87e4c9eb-9d08-4c05-8073-e46e338c3ad8', 'e0dfe6c2-3641-46bc-b13f-94573a76b8eb', 'e3afb646-7ec7-4b8f-a7d5-63d715b73d8f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:04 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:04 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-cefe0d3a-85ae-4368-9b65-0425f914b780-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-cefe0d3a-85ae-4368-9b65-0425f914b780-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6c48e-305f-4d13-9b32-754156fb5501]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:04 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Deleted volume successfully. Sep 02 13:05:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f1b978c-aecb-4d64-b255-857666998d5f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-ea66acca-64f5-4ae4-8606-81078409ec60-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:04 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 Sep 02 13:05:04 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:05 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:05 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780 Sep 02 13:05:05 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:05 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-cefe0d3a-85ae-4368-9b65-0425f914b780" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-quobyte-cefe0d3a-85ae-4368-9b65-0425f914b780" released by "delete_volume" :: held 0.800s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Created reservations ['6cbc1856-04ce-4dfb-a226-d32bef3f468e', '2fd5f108-6130-4bcf-aef1-acae98f14957', 'f589c029-522f-4456-a2ca-d2bc553ddf52', '5857561e-5c1b-4a96-995b-518d88a5877e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:05 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:05 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:05 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:05 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Deleted volume successfully. Sep 02 13:05:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9fbaec21-74b9-4a5b-a37d-a91bfd45376f tempest-VolumeDependencyTests-1312159790 None] Lock "cinder-cefe0d3a-85ae-4368-9b65-0425f914b780-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (4f6d2a42-742a-46ba-acf7-61ce782633ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373e3bbd-2215-43e4-97ea-bb9ea525d9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373e3bbd-2215-43e4-97ea-bb9ea525d9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337727615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76e8882-3bb3-43ec-905a-972d89a151a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:09Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf87fc3b-79e0-41a8-b0ee-fa3702aa8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf87fc3b-79e0-41a8-b0ee-fa3702aa8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92f8f43-a50f-4df9-9204-10eb288e659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92f8f43-a50f-4df9-9204-10eb288e659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76e8882-3bb3-43ec-905a-972d89a151a9', 'volume_name': 'volume-b76e8882-3bb3-43ec-905a-972d89a151a9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7aff5a-281f-4c5c-9e1f-5edee88554f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7aff5a-281f-4c5c-9e1f-5edee88554f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d31768-edce-43a0-a9cc-2a7d9ededbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Volume b76e8882-3bb3-43ec-905a-972d89a151a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76e8882-3bb3-43ec-905a-972d89a151a9', 'volume_size': 1} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337727615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76e8882-3bb3-43ec-905a-972d89a151a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:09Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Creating volume b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:08 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 1073741824 Sep 02 13:05:08 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:09 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 1073741824" returned: 0 in 0.524s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:09 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 Sep 02 13:05:09 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:09 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d31768-edce-43a0-a9cc-2a7d9ededbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76e8882-3bb3-43ec-905a-972d89a151a9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dd8024-f368-4aa0-bac6-6c4ed2b71bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Volume volume-b76e8882-3bb3-43ec-905a-972d89a151a9 (b76e8882-3bb3-43ec-905a-972d89a151a9): created successfully Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dd8024-f368-4aa0-bac6-6c4ed2b71bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (4f6d2a42-742a-46ba-acf7-61ce782633ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-200fb14b-e252-470f-b3c9-b2713c3d6f46 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (cabaa326-5be7-4d42-a0c8-188a24dfed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b80b87a-0ff8-4801-95b5-93ee61693ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b80b87a-0ff8-4801-95b5-93ee61693ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202103764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbc55ed-55ff-46f9-adb1-2b6d90614b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:10Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86558ba2-0e3b-428e-aeda-cd09aa31c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86558ba2-0e3b-428e-aeda-cd09aa31c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28b6114-f25f-4a3e-aa75-3bf1443e6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28b6114-f25f-4a3e-aa75-3bf1443e6f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dbc55ed-55ff-46f9-adb1-2b6d90614b73', 'volume_name': 'volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06889576-c7bc-4ca4-97f9-aa2e9f997d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06889576-c7bc-4ca4-97f9-aa2e9f997d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3ce78-377f-4bc5-b62f-2e7b3f512ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Volume 7dbc55ed-55ff-46f9-adb1-2b6d90614b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73', 'volume_size': 1} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1202103764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbc55ed-55ff-46f9-adb1-2b6d90614b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:10Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Creating volume 7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:10 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 1073741824 Sep 02 13:05:10 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:10 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 1073741824" returned: 0 in 0.499s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:10 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 Sep 02 13:05:10 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:11 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3ce78-377f-4bc5-b62f-2e7b3f512ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97cefe0-0731-4c90-acb5-1fcfaad90d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Volume volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 (7dbc55ed-55ff-46f9-adb1-2b6d90614b73): created successfully Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97cefe0-0731-4c90-acb5-1fcfaad90d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (cabaa326-5be7-4d42-a0c8-188a24dfed73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-86cf2124-de12-44dd-85fb-1e68c239c0ba tempest-ProjectReaderTests-1063130721 None] Created volume successfully. Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot 341b1735-b17c-49c7-a2f1-4b81976cd410 of volume b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81424d-3ae5-4dd3-b174-c12f88fe0c40]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:11 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 Sep 02 13:05:11 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:11 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:11 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 1G Sep 02 13:05:11 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:12 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 1G" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76e8882-3bb3-43ec-905a-972d89a151a9 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:12 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76e8882-3bb3-43ec-905a-972d89a151a9 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 Sep 02 13:05:12 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:12 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76e8882-3bb3-43ec-905a-972d89a151a9 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410" returned: 0 in 0.305s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 is being set with open permissions: ugo+rw Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:12 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 Sep 02 13:05:12 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:12 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410" returned: 0 in 0.234s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:12 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info Sep 02 13:05:12 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:12 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info is being set with open permissions: ugo+rw Sep 02 13:05:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:12 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info Sep 02 13:05:12 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:13 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.info" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.844s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Creating offline snapshot 1ef75f54-c05d-4ce3-adc8-f484e12c8dde of volume 7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f1e2b430-68d0-44ca-bbce-63f68e3dc66b tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d929e0b-2bef-4d71-91cf-029c8b9214d2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:13 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 Sep 02 13:05:13 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-341b1735-b17c-49c7-a2f1-4b81976cd410-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-341b1735-b17c-49c7-a2f1-4b81976cd410-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-341b1735-b17c-49c7-a2f1-4b81976cd410" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-341b1735-b17c-49c7-a2f1-4b81976cd410" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot 341b1735-b17c-49c7-a2f1-4b81976cd410 of volume b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92278d9-412d-4aa1-ba78-12acb12ca09b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:13 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:13 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 Sep 02 13:05:13 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:13 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde 1G Sep 02 13:05:13 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:13 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76e8882-3bb3-43ec-905a-972d89a151a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd3b35-8bcb-4aea-9b07-dd46a5822677]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 Sep 02 13:05:14 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde 1G" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde Sep 02 13:05:14 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 Sep 02 13:05:14 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde is being set with open permissions: ugo+rw Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde Sep 02 13:05:14 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410" returned: 0 in 0.346s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410 Sep 02 13:05:14 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info Sep 02 13:05:14 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9.341b1735-b17c-49c7-a2f1-4b81976cd410" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info is being set with open permissions: ugo+rw Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:14 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info Sep 02 13:05:14 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-341b1735-b17c-49c7-a2f1-4b81976cd410" released by "_delete_snapshot" :: held 1.471s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" released by "delete_snapshot" :: held 1.493s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Created reservations ['80db0fef-4cce-4c45-809c-fba38dad2d90', '4ed6db2b-4f34-45b9-9ef6-b24d3c72bc1a', '28f7f048-c68f-4c32-a16e-46f8ad2386c9', 'ff2caa40-2bae-4f5d-bab0-940c21821a46'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bac8ec18-7ee1-4b94-9e2e-33c4c72a939d tempest-ProjectMemberTests-1842815735 None] Lock "cinder-341b1735-b17c-49c7-a2f1-4b81976cd410-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:15 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.info" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21633484-e78c-47bf-add6-46f57b5bdab9 tempest-ProjectReaderTests-1063130721 None] Create snapshot completed successfully Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-b76e8882-3bb3-43ec-905a-972d89a151a9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-b76e8882-3bb3-43ec-905a-972d89a151a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[56884f39-c73e-4924-bede-003f857982c9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-1ef75f54-c05d-4ce3-adc8-f484e12c8dde-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-1ef75f54-c05d-4ce3-adc8-f484e12c8dde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-1ef75f54-c05d-4ce3-adc8-f484e12c8dde" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-1ef75f54-c05d-4ce3-adc8-f484e12c8dde" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Deleting offline snapshot 1ef75f54-c05d-4ce3-adc8-f484e12c8dde of volume 7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] snapshot_file for this snap is: volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e7dae-a3a3-436e-8951-a4e6bbabd0a1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:15 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 Sep 02 13:05:15 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:15 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde Sep 02 13:05:15 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:16 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:16 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9 Sep 02 13:05:16 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:16 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d2b93-acf4-48ef-b9e9-3e42fa04a8f8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:16 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 Sep 02 13:05:16 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:16 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b76e8882-3bb3-43ec-905a-972d89a151a9" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b76e8882-3bb3-43ec-905a-972d89a151a9" released by "delete_volume" :: held 0.716s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Created reservations ['254720ea-4fab-4428-bafb-e9d5ad0b0d80', 'c9c67d34-ab6d-4c70-ba10-011361a20cc0', 'fadae215-502d-4624-ba1b-74c85ec41f35', 'd9bff7eb-deaf-4c5c-bc67-11d4592df109'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:16 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:16 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:16 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:16 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde Sep 02 13:05:16 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:16 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-beb43d7e-6be5-4154-9303-71f0dd9cbc36 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-b76e8882-3bb3-43ec-905a-972d89a151a9-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:16 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:17 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde Sep 02 13:05:17 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:17 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (77470df3-7734-4e9f-9e9e-f02c24ea5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b305c3e-1144-45d5-afac-0c9fdb566d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73.1ef75f54-c05d-4ce3-adc8-f484e12c8dde" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b305c3e-1144-45d5-afac-0c9fdb566d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882620898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608f732a-1114-4733-b7ba-743e44429c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:17Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a527a9-94ea-4175-b1c5-f56b5e52e7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a527a9-94ea-4175-b1c5-f56b5e52e7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5aa5d1-bf6b-49a2-88dd-51daa27ffd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5aa5d1-bf6b-49a2-88dd-51daa27ffd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608f732a-1114-4733-b7ba-743e44429c81', 'volume_name': 'volume-608f732a-1114-4733-b7ba-743e44429c81', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1871c-b53e-45d6-9523-1a6ca5a94b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1871c-b53e-45d6-9523-1a6ca5a94b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99e5de-c09a-4cef-ac10-105f779230aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Volume 608f732a-1114-4733-b7ba-743e44429c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608f732a-1114-4733-b7ba-743e44429c81', 'volume_size': 1} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882620898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608f732a-1114-4733-b7ba-743e44429c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:17Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Creating volume 608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-1ef75f54-c05d-4ce3-adc8-f484e12c8dde" released by "_delete_snapshot" :: held 1.544s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" released by "delete_snapshot" :: held 1.570s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:17 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 1073741824 Sep 02 13:05:17 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Created reservations ['5589b835-f561-45dd-abdd-bd7673b1e015', 'd349a823-f1cc-48d9-937b-eb55550282e1', '1ba8d56a-589c-4b97-ac08-1d25b1dd4b5d', '43e96fc5-6a8b-4d67-91e6-2aa5ebaedf3e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Delete snapshot completed successfully. Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ddba2697-836b-4831-8a21-b3f6d336d7ab tempest-ProjectReaderTests-1063130721 None] Lock "cinder-1ef75f54-c05d-4ce3-adc8-f484e12c8dde-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:17 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 1073741824" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:17 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 Sep 02 13:05:17 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-7dbc55ed-55ff-46f9-adb1-2b6d90614b73-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-7dbc55ed-55ff-46f9-adb1-2b6d90614b73-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:18 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ec4a9-6a19-450b-b8fe-ff24dd32e881]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99e5de-c09a-4cef-ac10-105f779230aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608f732a-1114-4733-b7ba-743e44429c81', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2570795-5004-4b4f-a775-a809b2cfb4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Volume volume-608f732a-1114-4733-b7ba-743e44429c81 (608f732a-1114-4733-b7ba-743e44429c81): created successfully Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2570795-5004-4b4f-a775-a809b2cfb4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (77470df3-7734-4e9f-9e9e-f02c24ea5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eaa6b459-8c2e-4394-b261-41050d1319ed tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:18 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 Sep 02 13:05:18 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot 61e415a4-16d0-47c8-bfdc-426061db6632 of volume 608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[befeae06-b23a-478a-9ef1-ef07e7ec6664]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:18 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:18 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73 Sep 02 13:05:18 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:18 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 Sep 02 13:05:18 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:18 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-7dbc55ed-55ff-46f9-adb1-2b6d90614b73" released by "delete_volume" :: held 0.757s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Created reservations ['1609bcf2-5300-45b4-9554-21591202030f', '449088e8-7a7a-4940-808f-2c02f4557a0c', '272f7b3e-1b35-4eaa-a026-4ed592b5a2de', '86f63012-e491-4537-bdaf-1ee722b0e9f0'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:18 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:18 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 1G Sep 02 13:05:18 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:18 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:18 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:19 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Deleted volume successfully. Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-948dd3d3-8765-4d21-9d96-d383d24b21a9 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-7dbc55ed-55ff-46f9-adb1-2b6d90614b73-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:19 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 1G" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608f732a-1114-4733-b7ba-743e44429c81 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:19 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608f732a-1114-4733-b7ba-743e44429c81 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 Sep 02 13:05:19 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (7aad765a-fac9-4a83-bdac-5f1b98380c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf6afef-d16d-4c71-99e2-ff8203b5692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf6afef-d16d-4c71-99e2-ff8203b5692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856776875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456e72d3-2ff1-45ad-a60f-52c33dbc5e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:20Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb64c65-28b8-4e26-afb1-341c659f49a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:19 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb64c65-28b8-4e26-afb1-341c659f49a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53921842-56a0-4bcf-bddf-e82f82fd9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53921842-56a0-4bcf-bddf-e82f82fd9874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456e72d3-2ff1-45ad-a60f-52c33dbc5e9f', 'volume_name': 'volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a04983c-066a-44c7-a63f-9aae18646233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a04983c-066a-44c7-a63f-9aae18646233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f6a4d2-0277-477a-bdd5-c4f02108433b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Volume 456e72d3-2ff1-45ad-a60f-52c33dbc5e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f', 'volume_size': 1} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608f732a-1114-4733-b7ba-743e44429c81 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:19 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 is being set with open permissions: ugo+rw Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:19 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 Sep 02 13:05:19 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:19 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:19 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info Sep 02 13:05:19 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:20 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:20 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info is being set with open permissions: ugo+rw Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:20 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info Sep 02 13:05:20 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:20 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.info" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856776875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456e72d3-2ff1-45ad-a60f-52c33dbc5e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:20Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Creating volume 456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:20 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:20 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f 1073741824 Sep 02 13:05:20 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9cf585dc-c536-4bf1-a22b-f7de5f33afb1 tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:20 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f 1073741824" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:21 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f Sep 02 13:05:21 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:21 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f6a4d2-0277-477a-bdd5-c4f02108433b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33877eaa-7504-4238-b225-957fc190357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Volume volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f (456e72d3-2ff1-45ad-a60f-52c33dbc5e9f): created successfully Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33877eaa-7504-4238-b225-957fc190357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (7aad765a-fac9-4a83-bdac-5f1b98380c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1d9171f9-7768-423d-902b-6ce67e0f001f tempest-ProjectReaderTests-1063130721 None] Created volume successfully. Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-61e415a4-16d0-47c8-bfdc-426061db6632-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-61e415a4-16d0-47c8-bfdc-426061db6632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-61e415a4-16d0-47c8-bfdc-426061db6632" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-61e415a4-16d0-47c8-bfdc-426061db6632" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot 61e415a4-16d0-47c8-bfdc-426061db6632 of volume 608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644839a-bd3d-494b-9403-59f2ee42a2cb]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:21 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 Sep 02 13:05:21 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Creating offline snapshot ad64c311-271c-4f1b-b3a0-c8e88cbd12fa of volume 456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856ee06-a0aa-4d68-8b70-0a2c5d27b8e9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f Sep 02 13:05:22 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:22 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-608f732a-1114-4733-b7ba-743e44429c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f34924-6a59-4019-a1d7-db5ad54c12fa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 Sep 02 13:05:22 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:22 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa 1G Sep 02 13:05:22 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:22 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 Sep 02 13:05:22 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:22 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa 1G" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa Sep 02 13:05:22 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:22 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:22 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632 Sep 02 13:05:22 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:23 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:23 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa is being set with open permissions: ugo+rw Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:23 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa Sep 02 13:05:23 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:23 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81.61e415a4-16d0-47c8-bfdc-426061db6632" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-61e415a4-16d0-47c8-bfdc-426061db6632" released by "_delete_snapshot" :: held 1.531s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" released by "delete_snapshot" :: held 1.554s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Created reservations ['c2884f4b-84ec-4864-a93c-d92a612f61c4', '45d0efa5-2276-4497-9429-2ae8eaa2b6f3', '64ae009a-3e3c-4b00-a8ee-66f6f61fbd07', 'def47fe4-979f-4f2d-a443-d03e5e2e7548'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f28ff675-175f-4684-bf4a-8d0b2cc63360 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-61e415a4-16d0-47c8-bfdc-426061db6632-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:23 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:23 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info Sep 02 13:05:23 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:23 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:23 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info is being set with open permissions: ugo+rw Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:23 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info Sep 02 13:05:23 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-608f732a-1114-4733-b7ba-743e44429c81-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-608f732a-1114-4733-b7ba-743e44429c81-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:23 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.info" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2c33e095-d841-47c0-aa7f-26346bca3c6c tempest-ProjectReaderTests-1063130721 None] Create snapshot completed successfully Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dbcefa-4ce6-47b0-a953-8942f9b3dc09]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:24 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 Sep 02 13:05:24 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:24 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:24 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81 Sep 02 13:05:24 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:24 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-608f732a-1114-4733-b7ba-743e44429c81" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-608f732a-1114-4733-b7ba-743e44429c81" released by "delete_volume" :: held 0.667s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Created reservations ['c97e8305-2c08-4b4d-a694-4827139bd1e1', '0dbc27d5-ecc0-4d0e-9451-b730c89b06c6', '7c5dfc8f-b9d2-42e5-b6cb-1d52dc7eb0ae', 'cb553542-b85b-4972-823d-fb0ccd3ad593'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:24 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:24 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:24 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e1607e18-ff0f-43e6-aee6-1910c9d0de81 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-608f732a-1114-4733-b7ba-743e44429c81-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Deleting offline snapshot ad64c311-271c-4f1b-b3a0-c8e88cbd12fa of volume 456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] snapshot_file for this snap is: volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e900b4-894a-40c0-9387-adb85da460df]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:25 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa Sep 02 13:05:25 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (8e162986-5c7c-4afe-baca-c71817d90146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2410341b-82f1-4852-93ea-7e5729f73d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2410341b-82f1-4852-93ea-7e5729f73d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668104465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ae53e3-7d6f-4f1b-b35f-60b961068614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:25Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d7f09d-3c16-4fd8-a3fe-3bf9909bd5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d7f09d-3c16-4fd8-a3fe-3bf9909bd5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76efa373-4077-44e4-9110-0a51c7cf56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76efa373-4077-44e4-9110-0a51c7cf56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ae53e3-7d6f-4f1b-b35f-60b961068614', 'volume_name': 'volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0714c1af-a97b-4b70-8ca5-4040ea5e662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0714c1af-a97b-4b70-8ca5-4040ea5e662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340d59dd-47ba-4ae7-b952-54d730e9845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Volume f5ae53e3-7d6f-4f1b-b35f-60b961068614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614', 'volume_size': 1} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668104465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ae53e3-7d6f-4f1b-b35f-60b961068614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:25Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Creating volume f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:25 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:25 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:25 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 1073741824 Sep 02 13:05:25 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ef79f-2500-4dad-954c-7df08898ffc8]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:25 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f Sep 02 13:05:25 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:25 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:25 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 1073741824" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:26 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa Sep 02 13:05:26 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:26 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 Sep 02 13:05:26 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:26 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340d59dd-47ba-4ae7-b952-54d730e9845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4158bcb-fb91-424c-a5f0-f2a00fd44276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Volume volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 (f5ae53e3-7d6f-4f1b-b35f-60b961068614): created successfully Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4158bcb-fb91-424c-a5f0-f2a00fd44276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (8e162986-5c7c-4afe-baca-c71817d90146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef026fc4-1862-45c3-a5f5-5d9cf67a2a98 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:26 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:26 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa Sep 02 13:05:26 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:26 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f.ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot a1aa48dd-2746-404a-87fd-f0811084cfd0 of volume f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa" released by "_delete_snapshot" :: held 1.573s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" released by "delete_snapshot" :: held 1.601s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bbe496-1a7a-4755-a095-5d78cef1be47]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Created reservations ['158f4c4f-c663-49a9-a6ca-e3a3fa7977d3', 'a27fcb14-d831-4e72-b19e-fa38770ba2d0', '22deceb9-4cbe-46ad-b739-2862dd8512d7', '5483b318-15a7-427e-94c1-698e1f303d0d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:26 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 Sep 02 13:05:26 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Delete snapshot completed successfully. Sep 02 13:05:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b1581e7e-8b05-4d4d-8381-659c43eda921 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-ad64c311-271c-4f1b-b3a0-c8e88cbd12fa-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:27 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:27 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 1G Sep 02 13:05:27 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec151bcb-a5e1-45d3-998f-8d7b956ffc09]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:27 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f Sep 02 13:05:27 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:27 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 1G" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:27 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 Sep 02 13:05:27 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:27 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:27 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f Sep 02 13:05:27 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:27 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:27 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 is being set with open permissions: ugo+rw Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:27 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 Sep 02 13:05:27 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:27 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f" released by "delete_volume" :: held 0.700s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:28 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Created reservations ['7003c69f-946a-4190-9c51-100d9c90083b', 'd1b384ee-ead0-493a-9ce5-22843132d7f4', '207180eb-5892-4ace-a290-afc57cbfd5a9', '7a0f4185-3703-4d9d-b564-93d781120e7b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:28 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info Sep 02 13:05:28 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:28 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:28 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:28 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:28 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info is being set with open permissions: ugo+rw Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:28 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info Sep 02 13:05:28 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:28 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Deleted volume successfully. Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-52015cb5-dce9-4756-a657-0f7a0a6d85e7 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-456e72d3-2ff1-45ad-a60f-52c33dbc5e9f-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:28 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.info" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c2509de3-7b20-42f5-8022-98124d28bac3 tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (f20b1e5a-6010-43ab-9d34-035667298845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccc5878-d124-4341-8018-579649ccaeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccc5878-d124-4341-8018-579649ccaeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597734001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b320d854-eb36-4bf2-8bf1-e633b53202f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:29Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111e08b-8388-486d-a1b2-b72902b25813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111e08b-8388-486d-a1b2-b72902b25813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c58b645-4745-42ec-a83f-9cf4c7ec7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c58b645-4745-42ec-a83f-9cf4c7ec7ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b320d854-eb36-4bf2-8bf1-e633b53202f1', 'volume_name': 'volume-b320d854-eb36-4bf2-8bf1-e633b53202f1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c16bff-81c3-49ab-bd82-d72cd7be6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c16bff-81c3-49ab-bd82-d72cd7be6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4adcafa-0e21-4749-ac46-abc4c2bc4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Volume b320d854-eb36-4bf2-8bf1-e633b53202f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b320d854-eb36-4bf2-8bf1-e633b53202f1', 'volume_size': 1} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597734001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b320d854-eb36-4bf2-8bf1-e633b53202f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:29Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Creating volume b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:28 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 1073741824 Sep 02 13:05:28 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:29 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 1073741824" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:29 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 Sep 02 13:05:29 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:29 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4adcafa-0e21-4749-ac46-abc4c2bc4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b320d854-eb36-4bf2-8bf1-e633b53202f1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a091f44-b9da-4713-808f-0075abc7b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Volume volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 (b320d854-eb36-4bf2-8bf1-e633b53202f1): created successfully Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a091f44-b9da-4713-808f-0075abc7b01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (f20b1e5a-6010-43ab-9d34-035667298845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-39dbccba-cddd-4724-8cd8-a49c193a9360 tempest-ProjectReaderTests-1063130721 None] Created volume successfully. Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-a1aa48dd-2746-404a-87fd-f0811084cfd0-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-a1aa48dd-2746-404a-87fd-f0811084cfd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-a1aa48dd-2746-404a-87fd-f0811084cfd0" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-a1aa48dd-2746-404a-87fd-f0811084cfd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot a1aa48dd-2746-404a-87fd-f0811084cfd0 of volume f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2101fc18-b64e-464e-983a-26dfdc81404b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 Sep 02 13:05:30 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Creating offline snapshot b9d456c5-c6c7-42ac-8872-be1651934989 of volume b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb67391f-3bca-4796-b3a3-f9b60c77deb3]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 Sep 02 13:05:30 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:30 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0" returned: 0 in 0.397s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[db077cf8-1c24-4bfb-beee-0c2b4907a7da]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 Sep 02 13:05:30 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:30 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 1G Sep 02 13:05:30 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:30 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 Sep 02 13:05:30 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:30 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 1G" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:30 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 Sep 02 13:05:30 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:31 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:31 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0 Sep 02 13:05:31 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:31 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 is being set with open permissions: ugo+rw Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:31 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 Sep 02 13:05:31 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:31 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614.a1aa48dd-2746-404a-87fd-f0811084cfd0" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-a1aa48dd-2746-404a-87fd-f0811084cfd0" released by "_delete_snapshot" :: held 1.535s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" released by "delete_snapshot" :: held 1.559s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Created reservations ['3de25488-ea1f-49f0-a8da-de711303a158', 'a0099126-fb67-4a13-926c-d545b3360ac6', '2e977ffd-f62c-4414-9440-4e1450627b6c', 'e6301acd-2f39-4e07-aad9-460fb0e4a780'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:31 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:31 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info Sep 02 13:05:31 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21e42fe8-6c9b-4402-8309-b6fcbbbb6eec tempest-ProjectMemberTests-1842815735 None] Lock "cinder-a1aa48dd-2746-404a-87fd-f0811084cfd0-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:31 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info is being set with open permissions: ugo+rw Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:31 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info Sep 02 13:05:31 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-f5ae53e3-7d6f-4f1b-b35f-60b961068614-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f5ae53e3-7d6f-4f1b-b35f-60b961068614-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:32 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.info" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6e38d-9333-4a13-a0be-cb27bcc988e1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d63f39d-31db-4ae2-9989-38b0a03a368a tempest-ProjectReaderTests-1063130721 None] Create snapshot completed successfully Sep 02 13:05:32 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 Sep 02 13:05:32 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:32 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:32 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614 Sep 02 13:05:32 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:32 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f5ae53e3-7d6f-4f1b-b35f-60b961068614" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f5ae53e3-7d6f-4f1b-b35f-60b961068614" released by "delete_volume" :: held 0.680s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Created reservations ['96239880-0265-4bd0-85ee-1dba0548083c', '60d287be-7835-432c-b0eb-5a923abfe980', '914bbd99-92d9-4394-87d1-96956104ee49', 'a932d5e5-3bcc-4849-864a-29ebcf990ad8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:32 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:32 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:33 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-465d0841-9aa4-487d-9398-6d11541c51b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f5ae53e3-7d6f-4f1b-b35f-60b961068614-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-b9d456c5-c6c7-42ac-8872-be1651934989-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b9d456c5-c6c7-42ac-8872-be1651934989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-b9d456c5-c6c7-42ac-8872-be1651934989" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b9d456c5-c6c7-42ac-8872-be1651934989" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Deleting offline snapshot b9d456c5-c6c7-42ac-8872-be1651934989 of volume b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] snapshot_file for this snap is: volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a0e11-6918-41f3-a904-bbd1c956523f]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:33 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 Sep 02 13:05:33 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (273c7507-74f5-472a-a9a7-4e586c5bbf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e01a98-1dfa-420a-85eb-423af5daa549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e01a98-1dfa-420a-85eb-423af5daa549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881733361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd59c8fe-7d95-4516-b522-c78e491ae40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:34Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0dbc85-b56e-4e2f-8800-8b5ee8bd69d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0dbc85-b56e-4e2f-8800-8b5ee8bd69d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbe3f23-75f3-4d37-8d82-8c43957e28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbe3f23-75f3-4d37-8d82-8c43957e28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd59c8fe-7d95-4516-b522-c78e491ae40e', 'volume_name': 'volume-bd59c8fe-7d95-4516-b522-c78e491ae40e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad29739-7e47-4fe9-ac59-83d14bdda07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad29739-7e47-4fe9-ac59-83d14bdda07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db930a27-5e45-4ef2-bbcc-43368c6325d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Volume bd59c8fe-7d95-4516-b522-c78e491ae40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd59c8fe-7d95-4516-b522-c78e491ae40e', 'volume_size': 1} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881733361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd59c8fe-7d95-4516-b522-c78e491ae40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:34Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Creating volume bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:33 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b320d854-eb36-4bf2-8bf1-e633b53202f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:33 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e 1073741824 Sep 02 13:05:33 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9d21a-d4b9-4d10-9125-4b056766eca2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:33 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 Sep 02 13:05:33 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:34 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:34 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e 1073741824" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:34 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 Sep 02 13:05:34 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:34 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e Sep 02 13:05:34 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:34 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:34 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db930a27-5e45-4ef2-bbcc-43368c6325d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd59c8fe-7d95-4516-b522-c78e491ae40e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432cfdd3-1787-471f-bcaa-04e3be93358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:34 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989 Sep 02 13:05:34 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Volume volume-bd59c8fe-7d95-4516-b522-c78e491ae40e (bd59c8fe-7d95-4516-b522-c78e491ae40e): created successfully Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432cfdd3-1787-471f-bcaa-04e3be93358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (273c7507-74f5-472a-a9a7-4e586c5bbf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-91ae05e6-2311-49a4-b320-0be5c1d40a18 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:34 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1.b9d456c5-c6c7-42ac-8872-be1651934989" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b9d456c5-c6c7-42ac-8872-be1651934989" released by "_delete_snapshot" :: held 1.513s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" released by "delete_snapshot" :: held 1.539s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Created reservations ['3ccd5412-a8e1-4973-9d56-c79ab2925db6', '9e6f4201-a21b-4dce-9aa5-07eaebe5f6fe', '50a1021a-73e6-40be-8703-dbd1dfc4cf02', 'a5ed9dc0-b94e-4332-91c1-1dc4724c07de'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Delete snapshot completed successfully. Sep 02 13:05:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-80cc2617-080a-40a2-aa9b-2503066bc74f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b9d456c5-c6c7-42ac-8872-be1651934989-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-b320d854-eb36-4bf2-8bf1-e633b53202f1-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b320d854-eb36-4bf2-8bf1-e633b53202f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0c93d5-cb79-481b-be4c-6e9017aa9224]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:35 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 Sep 02 13:05:35 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot be9db455-8999-4be7-9c7b-515f321031b3 of volume bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac1fda1-baa1-45f0-9c83-b64f2fde783a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:35 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1" returned: 0 in 0.416s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:35 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1 Sep 02 13:05:35 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:35 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e Sep 02 13:05:35 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:36 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b320d854-eb36-4bf2-8bf1-e633b53202f1" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b320d854-eb36-4bf2-8bf1-e633b53202f1" released by "delete_volume" :: held 0.726s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:36 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Created reservations ['2872c67e-986c-4679-a915-22dae1af6758', '067a580f-4689-406b-baa9-74dce3b4b8b4', 'c153f1f7-230f-41df-b08f-7d48d90fc1a6', '06cf9d4c-2c7b-41ed-b2c8-039cfc0b9b40'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:36 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 1G Sep 02 13:05:36 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:36 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:36 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:36 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Deleted volume successfully. Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7fab59f-2405-4e27-8bc4-47ad699677f2 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b320d854-eb36-4bf2-8bf1-e633b53202f1-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:36 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 1G" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd59c8fe-7d95-4516-b522-c78e491ae40e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:36 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd59c8fe-7d95-4516-b522-c78e491ae40e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 Sep 02 13:05:36 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd59c8fe-7d95-4516-b522-c78e491ae40e -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:37 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 is being set with open permissions: ugo+rw Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:37 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 Sep 02 13:05:37 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (849ed814-a750-43cc-8620-66f777d963ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d541a3-67f2-4ac9-93b2-ac9e9896ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d541a3-67f2-4ac9-93b2-ac9e9896ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068030407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8d4fb2-8f37-46e5-8fff-905b34c46536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:37Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a55a6c-8d22-4ec5-8082-28ba55a6b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a55a6c-8d22-4ec5-8082-28ba55a6b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c98fd1-b5f0-48ab-82c0-5e1639022117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c98fd1-b5f0-48ab-82c0-5e1639022117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8d4fb2-8f37-46e5-8fff-905b34c46536', 'volume_name': 'volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa15fe79-a7b5-4288-8db4-54116be24689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa15fe79-a7b5-4288-8db4-54116be24689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea1a76b-0a85-4151-9fa4-a0109559647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Volume 0d8d4fb2-8f37-46e5-8fff-905b34c46536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536', 'volume_size': 1} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:37 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:37 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info Sep 02 13:05:37 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:37 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:37 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:37 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info is being set with open permissions: ugo+rw Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:37 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info Sep 02 13:05:37 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:05:37 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.info" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068030407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8d4fb2-8f37-46e5-8fff-905b34c46536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:37Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Creating volume 0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:37 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 1073741824 Sep 02 13:05:37 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-276d5d2e-e44f-4ec2-b532-7ca1903b575e tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:38 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 1073741824" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:38 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 Sep 02 13:05:38 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:38 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea1a76b-0a85-4151-9fa4-a0109559647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984ed294-fb99-4d74-9df3-227a03ff3db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Volume volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 (0d8d4fb2-8f37-46e5-8fff-905b34c46536): created successfully Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984ed294-fb99-4d74-9df3-227a03ff3db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (849ed814-a750-43cc-8620-66f777d963ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45fd048d-05b0-4a14-abe9-c30c6fcd1c2d tempest-ProjectReaderTests-1063130721 None] Created volume successfully. Sep 02 13:05:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-be9db455-8999-4be7-9c7b-515f321031b3-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-be9db455-8999-4be7-9c7b-515f321031b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-be9db455-8999-4be7-9c7b-515f321031b3" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-be9db455-8999-4be7-9c7b-515f321031b3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot be9db455-8999-4be7-9c7b-515f321031b3 of volume bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9191d28-79ba-4ad1-ad0b-f8f714a26e08]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:39 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 Sep 02 13:05:39 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Creating offline snapshot 61c1b2a0-9896-49c6-be60-e45eaa4bc75f of volume 0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa77bf-6eb8-40fa-9744-9c774b009fae]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:39 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 Sep 02 13:05:39 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:39 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd59c8fe-7d95-4516-b522-c78e491ae40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e4148d-c6c3-4c96-901b-07ce541e832e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:39 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e Sep 02 13:05:39 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:39 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:39 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f 1G Sep 02 13:05:39 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:39 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:39 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 Sep 02 13:05:39 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:40 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f 1G" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:40 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f Sep 02 13:05:40 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:40 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:40 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3 Sep 02 13:05:40 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:40 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f" returned: 0 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:40 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f is being set with open permissions: ugo+rw Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:40 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:40 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f Sep 02 13:05:40 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e.be9db455-8999-4be7-9c7b-515f321031b3" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-be9db455-8999-4be7-9c7b-515f321031b3" released by "_delete_snapshot" :: held 1.491s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" released by "delete_snapshot" :: held 1.514s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Created reservations ['63854693-3c2b-4f57-96ce-874bed761b6a', '7107486e-9c48-40ec-bd3c-f452bb619b78', 'ef76e273-c08d-48fc-be0e-c2013dd39268', '714220b6-8e2f-44c8-a3e4-1e072e7639ca'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb662314-da13-4abc-8555-6d7dc35a1e00 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-be9db455-8999-4be7-9c7b-515f321031b3-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:40 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:40 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info Sep 02 13:05:40 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:40 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:41 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info is being set with open permissions: ugo+rw Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:41 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info Sep 02 13:05:41 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-bd59c8fe-7d95-4516-b522-c78e491ae40e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-bd59c8fe-7d95-4516-b522-c78e491ae40e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:41 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8aa690-f692-4269-95a6-ed9aa876880c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.info" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-117980f1-9824-454b-8f3a-902079dc7180 tempest-ProjectReaderTests-1063130721 None] Create snapshot completed successfully Sep 02 13:05:41 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e Sep 02 13:05:41 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:41 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e" returned: 0 in 0.367s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:41 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e Sep 02 13:05:41 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:41 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-bd59c8fe-7d95-4516-b522-c78e491ae40e" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-bd59c8fe-7d95-4516-b522-c78e491ae40e" released by "delete_volume" :: held 0.670s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Created reservations ['c3c84e33-acb4-448c-9b56-cef035c27202', 'a375de73-80ba-4c48-b1f7-842cec82c10f', 'c80698e5-8377-4f7b-8f6d-49d234ee2111', '4e33863d-065e-486a-bfbc-8d2be4baf24b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:42 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:42 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:42 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ade82509-20aa-457c-aa64-3b9febc96202 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-bd59c8fe-7d95-4516-b522-c78e491ae40e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-61c1b2a0-9896-49c6-be60-e45eaa4bc75f-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-61c1b2a0-9896-49c6-be60-e45eaa4bc75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-61c1b2a0-9896-49c6-be60-e45eaa4bc75f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-61c1b2a0-9896-49c6-be60-e45eaa4bc75f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Deleting offline snapshot 61c1b2a0-9896-49c6-be60-e45eaa4bc75f of volume 0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] snapshot_file for this snap is: volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc7777-6ccf-4056-8f1e-69729466d27c]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:42 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f Sep 02 13:05:42 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (ed61c58b-4e15-4521-b727-68a5551a48fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde4bcd0-2712-4012-bf1c-a138aea819c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde4bcd0-2712-4012-bf1c-a138aea819c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782060368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:43Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803091a7-38f7-411a-a26f-a2b70b1adc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803091a7-38f7-411a-a26f-a2b70b1adc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c88aa06-a812-4115-a44f-6b3c4b442a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c88aa06-a812-4115-a44f-6b3c4b442a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3', 'volume_name': 'volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51b029f-df53-4e0a-8879-8745afe041fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51b029f-df53-4e0a-8879-8745afe041fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881fe503-cc0a-4e05-bf91-2e94512251c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Volume f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3', 'volume_size': 1} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782060368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:43Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Creating volume f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:42 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 1073741824 Sep 02 13:05:42 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:42 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad94ab3-4eae-4125-90fa-e557aa4757c5]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:43 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 Sep 02 13:05:43 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:43 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 1073741824" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:43 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 Sep 02 13:05:43 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:43 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:43 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f Sep 02 13:05:43 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:43 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881fe503-cc0a-4e05-bf91-2e94512251c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98fef4-d4df-4b5e-ba02-bf4933e54aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Volume volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 (f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3): created successfully Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98fef4-d4df-4b5e-ba02-bf4933e54aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (ed61c58b-4e15-4521-b727-68a5551a48fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-01ea4e9b-969b-4c54-93bd-6bd2c16c869b tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:43 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:43 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f Sep 02 13:05:43 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot 243ac937-6728-4a6b-a013-cf4bb8c0804a of volume f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:43 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536.61c1b2a0-9896-49c6-be60-e45eaa4bc75f" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6480299-49ac-4070-8ea6-8f1beb5432ae]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-61c1b2a0-9896-49c6-be60-e45eaa4bc75f" released by "_delete_snapshot" :: held 1.469s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" released by "delete_snapshot" :: held 1.503s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Created reservations ['e3a18e58-51d7-4503-9d4d-92c9509c9c00', '2fce8594-1691-4d12-86a7-471679a2ff60', 'd619bf36-10ab-4a56-9e79-70ce956f37de', 'f7559017-e1f3-45ff-937c-4536530cfecc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:44 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 Sep 02 13:05:44 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Delete snapshot completed successfully. Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-46cea4f3-dbc9-45f5-b089-c5966be058d3 tempest-ProjectReaderTests-1063130721 None] Lock "cinder-61c1b2a0-9896-49c6-be60-e45eaa4bc75f-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:44 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:44 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a 1G Sep 02 13:05:44 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-0d8d4fb2-8f37-46e5-8fff-905b34c46536-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-0d8d4fb2-8f37-46e5-8fff-905b34c46536-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[37704c2e-13ca-4e16-8aed-121f78313046]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:44 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a 1G" returned: 0 in 0.438s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:44 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a Sep 02 13:05:44 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:44 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 Sep 02 13:05:44 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a" returned: 0 in 0.290s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a is being set with open permissions: ugo+rw Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:45 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:45 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a Sep 02 13:05:45 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536 Sep 02 13:05:45 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-0d8d4fb2-8f37-46e5-8fff-905b34c46536" returned: 0 in 0.247s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-0d8d4fb2-8f37-46e5-8fff-905b34c46536" released by "delete_volume" :: held 0.666s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:45 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info Sep 02 13:05:45 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Created reservations ['4d1b91ff-1bb7-49af-8b21-d5625ed3e72c', 'd3a72146-4935-4f3d-b873-42c20873f7f0', '3fbf85dd-4d20-4d50-a2e1-856ce5064759', '09ea8da8-3078-49bc-9ceb-96e14fd93f52'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:45 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:45 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info is being set with open permissions: ugo+rw Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:45 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info Sep 02 13:05:45 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:45 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Deleted volume successfully. Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ae7e357b-f066-438b-8110-429a78f2788f tempest-ProjectReaderTests-1063130721 None] Lock "cinder-0d8d4fb2-8f37-46e5-8fff-905b34c46536-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:45 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.info" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-41873144-8222-42a6-bd53-2926262530cc tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (527dcad6-970c-41d6-b5e1-b96acedaa461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef76140-6dc3-48b0-b63b-464f68f8e32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef76140-6dc3-48b0-b63b-464f68f8e32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15035056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3016b23-36a2-475d-a84a-24b71ffbcbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:46Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c587692-03a8-479d-a3ad-d77a75d85d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c587692-03a8-479d-a3ad-d77a75d85d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2becde14-bf71-4598-98bc-3046fa8075d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2becde14-bf71-4598-98bc-3046fa8075d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3016b23-36a2-475d-a84a-24b71ffbcbd1', 'volume_name': 'volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3399f3af-b892-422d-9545-749265cb96f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3399f3af-b892-422d-9545-749265cb96f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6786b4e0-b399-4ea3-85ad-2236ed22ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Volume b3016b23-36a2-475d-a84a-24b71ffbcbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1', 'volume_size': 1} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15035056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3016b23-36a2-475d-a84a-24b71ffbcbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d89ea75b2b8440ffb27403ef29a85201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:46Z,use_quota=True,user_id='a57ef8a00c58483894fa0e98fa5d5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Creating volume b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:46 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:46 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 1073741824 Sep 02 13:05:46 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:46 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 1073741824" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:46 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 Sep 02 13:05:46 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:47 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1" returned: 0 in 0.232s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6786b4e0-b399-4ea3-85ad-2236ed22ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33292753-1d7e-488c-91c8-e7937bcd8271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Volume volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 (b3016b23-36a2-475d-a84a-24b71ffbcbd1): created successfully Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33292753-1d7e-488c-91c8-e7937bcd8271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Flow 'volume_create_manager' (527dcad6-970c-41d6-b5e1-b96acedaa461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6fdb1c59-7149-4c3d-b885-7f981f7b985d tempest-ProjectReaderTests-1063130721 None] Created volume successfully. Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-243ac937-6728-4a6b-a013-cf4bb8c0804a-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-243ac937-6728-4a6b-a013-cf4bb8c0804a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-243ac937-6728-4a6b-a013-cf4bb8c0804a" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-243ac937-6728-4a6b-a013-cf4bb8c0804a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot 243ac937-6728-4a6b-a013-cf4bb8c0804a of volume f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35ee3e-6d74-468b-beb4-c6b732012b85]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:47 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a Sep 02 13:05:47 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Creating offline snapshot cf769382-ccda-4311-8287-3e7db5717f8a of volume b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[385798ad-7723-461e-90c6-93e171cfb1bf]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:47 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4f485-037c-4607-9713-d3e44d209a01]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:47 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 Sep 02 13:05:47 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:47 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 Sep 02 13:05:47 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:47 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:47 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a 1G Sep 02 13:05:47 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:47 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:47 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a Sep 02 13:05:47 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:48 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a 1G" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:48 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a Sep 02 13:05:48 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:48 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a" returned: 0 in 0.367s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:48 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a Sep 02 13:05:48 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:48 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:48 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a is being set with open permissions: ugo+rw Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:48 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3.243ac937-6728-4a6b-a013-cf4bb8c0804a" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:48 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a Sep 02 13:05:48 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-243ac937-6728-4a6b-a013-cf4bb8c0804a" released by "_delete_snapshot" :: held 1.440s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" released by "delete_snapshot" :: held 1.466s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Created reservations ['886129ae-b5fd-4b53-827e-254fb3db82c2', '76143518-a700-49f0-863e-34d9bdaa0f36', '3cc43494-3893-4da6-85d4-e2fa6366e038', '21ab0f91-16cb-4a12-81ea-11177470dc85'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f1a85bf7-3e8d-4080-9a14-fc8728641cdc tempest-ProjectMemberTests-1842815735 None] Lock "cinder-243ac937-6728-4a6b-a013-cf4bb8c0804a-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:48 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:48 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info Sep 02 13:05:48 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:49 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:49 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info is being set with open permissions: ugo+rw Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:49 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info Sep 02 13:05:49 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:49 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.info" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[26192353-872f-4b3e-93eb-cf8cc68fbad9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cfa95c25-8a16-4db8-be6a-afa8253b056d tempest-ProjectReaderTests-1063130721 None] Create snapshot completed successfully Sep 02 13:05:49 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 Sep 02 13:05:49 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-cf769382-ccda-4311-8287-3e7db5717f8a-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-cf769382-ccda-4311-8287-3e7db5717f8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-cf769382-ccda-4311-8287-3e7db5717f8a" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-cf769382-ccda-4311-8287-3e7db5717f8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Deleting offline snapshot cf769382-ccda-4311-8287-3e7db5717f8a of volume b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] snapshot_file for this snap is: volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d681a2-03c0-442a-8e51-d28c8b1c77ff]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:49 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:49 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a Sep 02 13:05:49 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:49 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3 Sep 02 13:05:49 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:50 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3" released by "delete_volume" :: held 0.666s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:50 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[69152223-e344-435b-bd52-37d40f677a7b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Created reservations ['60aea8f2-fd3c-4e28-80cd-79715ff9d5ee', '66104c6e-6990-4185-9479-c818ed753a59', '77895867-ac26-44e2-a4ff-76945456034a', '6c7bb388-b9fb-41f9-863c-43803e57d41a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:50 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 Sep 02 13:05:50 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:50 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:50 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:50 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-265adc0f-aefa-40b0-8fb0-dc08c50ca48f tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f7f97a94-71c4-4f9d-b5ee-9025a6c7c6e3-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:50 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:50 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a Sep 02 13:05:50 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:50 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:50 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a Sep 02 13:05:50 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (3752dc96-7c96-4137-b918-6e001f4c45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd24d5-c6b8-4988-8c88-3b18d6083d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd24d5-c6b8-4988-8c88-3b18d6083d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192308158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ae589-83eb-4e72-8f5d-636a5056d45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:51Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40bd04-58f4-44cf-aa1f-3078e770f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40bd04-58f4-44cf-aa1f-3078e770f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fcee9-f9df-4cae-887f-eb6ae42d104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fcee9-f9df-4cae-887f-eb6ae42d104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745ae589-83eb-4e72-8f5d-636a5056d45c', 'volume_name': 'volume-745ae589-83eb-4e72-8f5d-636a5056d45c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d0d94c-5ddc-4819-bfff-de86e25d9422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d0d94c-5ddc-4819-bfff-de86e25d9422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1263e7fb-9800-4635-9573-effe7df4cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Volume 745ae589-83eb-4e72-8f5d-636a5056d45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745ae589-83eb-4e72-8f5d-636a5056d45c', 'volume_size': 1} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192308158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ae589-83eb-4e72-8f5d-636a5056d45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:51Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Creating volume 745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:51 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:51 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c 1073741824 Sep 02 13:05:51 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:51 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1.cf769382-ccda-4311-8287-3e7db5717f8a" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-cf769382-ccda-4311-8287-3e7db5717f8a" released by "_delete_snapshot" :: held 1.511s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" released by "delete_snapshot" :: held 1.537s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Created reservations ['64e6b58d-bc44-441d-a9a2-524d449e0a61', '075e0515-6e22-4d28-a46a-d9c86c7c02a9', '55e3cd68-4917-4c0d-aea2-1e9d621e99cd', '2ff3ad40-23fb-4a18-8df2-041e3b332fc0'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Delete snapshot completed successfully. Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1a8a934-b448-47c5-8e37-8f8bb9b682cd tempest-ProjectReaderTests-1063130721 None] Lock "cinder-cf769382-ccda-4311-8287-3e7db5717f8a-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:51 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c 1073741824" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:51 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c Sep 02 13:05:51 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:51 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1263e7fb-9800-4635-9573-effe7df4cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745ae589-83eb-4e72-8f5d-636a5056d45c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4938ef44-6897-4cb5-bd6c-b275a1b0cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-b3016b23-36a2-475d-a84a-24b71ffbcbd1-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Volume volume-745ae589-83eb-4e72-8f5d-636a5056d45c (745ae589-83eb-4e72-8f5d-636a5056d45c): created successfully Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4938ef44-6897-4cb5-bd6c-b275a1b0cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (3752dc96-7c96-4137-b918-6e001f4c45e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b3016b23-36a2-475d-a84a-24b71ffbcbd1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5e380d35-9fbd-44af-a909-47e2da915676 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Acquiring lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb89df-8fde-4365-b368-4d72ad410290]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:51 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 Sep 02 13:05:51 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot f1d421ce-9aa1-4a3a-8946-ba75807662c0 of volume 745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e9e56-9721-47fa-b245-d366fff4886a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:52 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c Sep 02 13:05:52 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:52 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1 Sep 02 13:05:52 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:52 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 1G Sep 02 13:05:52 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:52 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b3016b23-36a2-475d-a84a-24b71ffbcbd1" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "cinder-quobyte-b3016b23-36a2-475d-a84a-24b71ffbcbd1" released by "delete_volume" :: held 0.689s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Created reservations ['9c230815-86b6-45c5-ab6b-243874685d76', 'b166a70a-f30e-4b6a-a2b4-a1056c443044', 'd49c3750-af82-4740-b0f7-7f8920bc2a07', '2c06c187-4105-4989-8268-1b8be0582225'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:52 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:52 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 1G" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745ae589-83eb-4e72-8f5d-636a5056d45c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:52 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745ae589-83eb-4e72-8f5d-636a5056d45c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 Sep 02 13:05:52 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:52 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Deleted volume successfully. Sep 02 13:05:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d9137059-6be2-4f22-919f-75f0485cbceb tempest-ProjectReaderTests-1063130721 None] Lock "cinder-b3016b23-36a2-475d-a84a-24b71ffbcbd1-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:53 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745ae589-83eb-4e72-8f5d-636a5056d45c -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:53 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 is being set with open permissions: ugo+rw Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:53 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 Sep 02 13:05:53 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:53 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:53 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info Sep 02 13:05:53 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:53 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:53 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info is being set with open permissions: ugo+rw Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:53 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info Sep 02 13:05:53 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:53 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.info" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cd995202-1f5f-45c7-a9fa-eea119a24df5 tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-f1d421ce-9aa1-4a3a-8946-ba75807662c0-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f1d421ce-9aa1-4a3a-8946-ba75807662c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-f1d421ce-9aa1-4a3a-8946-ba75807662c0" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f1d421ce-9aa1-4a3a-8946-ba75807662c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot f1d421ce-9aa1-4a3a-8946-ba75807662c0 of volume 745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c59aa-808a-49d4-b8e6-5c44240391fe]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:54 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 Sep 02 13:05:54 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:54 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-745ae589-83eb-4e72-8f5d-636a5056d45c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[00280736-1f99-4024-bdbd-d5094584d510]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:54 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c Sep 02 13:05:54 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:55 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:55 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 Sep 02 13:05:55 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:55 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:55 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0 Sep 02 13:05:55 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:55 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c.f1d421ce-9aa1-4a3a-8946-ba75807662c0" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-f1d421ce-9aa1-4a3a-8946-ba75807662c0" released by "_delete_snapshot" :: held 1.528s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" released by "delete_snapshot" :: held 1.557s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Created reservations ['54e84c7b-f5c2-49a0-8e4c-448e6a92d673', 'aebc2488-e9ec-4d4e-95fe-211ce08925b0', 'a3f2b492-cadc-4258-b99d-15fc0cc85797', '5a54c097-88ae-46d3-b4b1-03edb5539db8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:05:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9afe018d-c535-4780-8b73-6f882fc6b2b9 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-f1d421ce-9aa1-4a3a-8946-ba75807662c0-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-745ae589-83eb-4e72-8f5d-636a5056d45c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-745ae589-83eb-4e72-8f5d-636a5056d45c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[90559883-9d60-491d-9d5c-fd0261617656]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:56 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c Sep 02 13:05:56 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:56 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:56 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c Sep 02 13:05:56 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:57 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-745ae589-83eb-4e72-8f5d-636a5056d45c" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-745ae589-83eb-4e72-8f5d-636a5056d45c" released by "delete_volume" :: held 0.672s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Created reservations ['3d3cc7f3-7fc6-4f02-b206-5b43a5f4516b', '8916a472-0fc2-4d67-93a7-32c7b288a989', 'c0e7d829-4bae-40ce-bb98-ab55c5e0102a', '4dd71bcf-22d3-4305-a990-50b60d80fc4d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:57 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:05:57 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:57 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:05:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:05:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c870abd6-3abe-49aa-8a92-d9188bc783b3 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-745ae589-83eb-4e72-8f5d-636a5056d45c-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (12c332ab-46e4-49fc-81a9-fe6d779e4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f868d5c0-f3a9-4039-bceb-0b8362220e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f868d5c0-f3a9-4039-bceb-0b8362220e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947803411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:58Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efa22d9-3d72-4d64-8a29-ab24e3181c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efa22d9-3d72-4d64-8a29-ab24e3181c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebb2e0b-a720-4a9c-abbc-2dde9db1a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebb2e0b-a720-4a9c-abbc-2dde9db1a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a', 'volume_name': 'volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebb710c-2ab6-435a-8340-1db18cdef227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebb710c-2ab6-435a-8340-1db18cdef227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf538a86-2bad-4a7a-ba2e-0b6905ca908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Volume c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a', 'volume_size': 1} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947803411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:05:58Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Creating volume c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:05:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:58 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a 1073741824 Sep 02 13:05:58 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:58 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a 1073741824" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:58 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a Sep 02 13:05:58 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:58 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" returned: 0 in 0.235s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf538a86-2bad-4a7a-ba2e-0b6905ca908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5450594-f851-4070-8c04-532c01f4fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:05:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Volume volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a (c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a): created successfully Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5450594-f851-4070-8c04-532c01f4fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:05:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (12c332ab-46e4-49fc-81a9-fe6d779e4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:05:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ad78e082-3ca0-48bd-8060-fa96a5d3f631 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot fb6cacbb-5ca3-4b5e-875c-ad33902f222a of volume c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a33b9b-e9dd-43c7-acd8-ac02ee20c840]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:59 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a Sep 02 13:05:59 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:05:59 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:05:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:05:59 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a 1G Sep 02 13:05:59 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:00 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a 1G" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:00 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a Sep 02 13:06:00 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:00 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:00 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a is being set with open permissions: ugo+rw Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:00 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a Sep 02 13:06:00 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:00 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a" returned: 0 in 0.232s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=181,cinder:UPDATE=219,cinder:INSERT=60,cinder:DELETE=19 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=174,cinder:INSERT=64,cinder:UPDATE=233,cinder:DELETE=18 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:00 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info Sep 02 13:06:00 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:00 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:00 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info is being set with open permissions: ugo+rw Sep 02 13:06:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:00 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info Sep 02 13:06:00 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:01 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.info" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eb99d0af-6708-4579-99b0-2a95aec91aec tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-fb6cacbb-5ca3-4b5e-875c-ad33902f222a-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-fb6cacbb-5ca3-4b5e-875c-ad33902f222a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-fb6cacbb-5ca3-4b5e-875c-ad33902f222a" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-fb6cacbb-5ca3-4b5e-875c-ad33902f222a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot fb6cacbb-5ca3-4b5e-875c-ad33902f222a of volume c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b38f7-5f95-4337-91bb-bf2c8d79b11e]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:01 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a Sep 02 13:06:01 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:01 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba23692-bda2-47a8-ad40-eea7dd7debc9]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:02 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a Sep 02 13:06:02 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:02 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:02 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a Sep 02 13:06:02 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:02 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:02 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a Sep 02 13:06:02 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:02 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a.fb6cacbb-5ca3-4b5e-875c-ad33902f222a" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-fb6cacbb-5ca3-4b5e-875c-ad33902f222a" released by "_delete_snapshot" :: held 1.509s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" released by "delete_snapshot" :: held 1.534s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Created reservations ['919a15fc-6451-4777-8e80-56c47c418d2f', 'd7ba5dbf-30b0-428a-819b-f08f06f3ab74', '6dbcf5e2-ed65-4775-9dd8-049c31506be6', '8b03478b-bd59-4716-9e9a-0da5df797c32'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fdde9c99-dd7c-474c-846d-2b1df756ef4e tempest-ProjectMemberTests-1842815735 None] Lock "cinder-fb6cacbb-5ca3-4b5e-875c-ad33902f222a-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630ba9a-f150-4a4d-abcc-bcf8b9de735b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:03 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a Sep 02 13:06:03 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:04 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:04 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a Sep 02 13:06:04 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:04 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a" released by "delete_volume" :: held 0.686s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Created reservations ['3eb42207-7088-4f81-b0af-448fc3f95b07', '35ae4b3a-04f7-4330-8d05-32d025d500c5', '48d18ff1-0ec9-4e02-be62-02216870e07b', '189e37bf-1d83-4896-a515-026fa875ec4c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:04 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:04 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:04 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:06:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-211762a4-1393-4bed-b760-5addc2424742 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-c928ebf5-cc30-4dda-8fd4-2a7a8a10f54a-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (19aa8a7a-b092-44fd-a40a-f59272065057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd33fe7-59fc-4b2c-a7ba-00b70598a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd33fe7-59fc-4b2c-a7ba-00b70598a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931694109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1458e82-d1f9-4d2c-b241-6e720e10b751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:05Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505fb27-5f07-4f15-9e6b-7d3a2b81c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505fb27-5f07-4f15-9e6b-7d3a2b81c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ff8209-dcde-4012-b98f-5e8700d8b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ff8209-dcde-4012-b98f-5e8700d8b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1458e82-d1f9-4d2c-b241-6e720e10b751', 'volume_name': 'volume-b1458e82-d1f9-4d2c-b241-6e720e10b751', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f43aa0c-f9b3-41fe-a43a-a477fe6941b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f43aa0c-f9b3-41fe-a43a-a477fe6941b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a910fb-466c-404a-85c9-1ea982475e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Volume b1458e82-d1f9-4d2c-b241-6e720e10b751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1458e82-d1f9-4d2c-b241-6e720e10b751', 'volume_size': 1} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931694109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1458e82-d1f9-4d2c-b241-6e720e10b751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:05Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Creating volume b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:06:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:05 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 1073741824 Sep 02 13:06:05 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:05 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 1073741824" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:05 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 Sep 02 13:06:05 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:06 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a910fb-466c-404a-85c9-1ea982475e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1458e82-d1f9-4d2c-b241-6e720e10b751', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fbae84-b179-4ddb-8d5b-6a1ec1223532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Volume volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 (b1458e82-d1f9-4d2c-b241-6e720e10b751): created successfully Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fbae84-b179-4ddb-8d5b-6a1ec1223532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (19aa8a7a-b092-44fd-a40a-f59272065057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-66bfe38f-bc4a-4e43-9d7f-5dab947b9455 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot 19c1f760-7c90-461b-87d7-1bdbb77528d5 of volume b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a2f46-91a2-4c76-af2c-0ee63c8d72e4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:06 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 Sep 02 13:06:06 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:06 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:06 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 1G Sep 02 13:06:06 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:07 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 1G" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:07 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 Sep 02 13:06:07 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:07 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:07 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 is being set with open permissions: ugo+rw Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:07 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 Sep 02 13:06:07 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:07 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:07 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info Sep 02 13:06:07 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:08 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:08 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info is being set with open permissions: ugo+rw Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:08 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info Sep 02 13:06:08 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:08 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.info" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5373b0ec-059b-4611-8602-af0a7d690d1c tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-19c1f760-7c90-461b-87d7-1bdbb77528d5-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-19c1f760-7c90-461b-87d7-1bdbb77528d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-19c1f760-7c90-461b-87d7-1bdbb77528d5" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-19c1f760-7c90-461b-87d7-1bdbb77528d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot 19c1f760-7c90-461b-87d7-1bdbb77528d5 of volume b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea5ee22-c420-436a-91c3-cf19e3112081]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:08 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 Sep 02 13:06:08 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:09 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1458e82-d1f9-4d2c-b241-6e720e10b751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9818a70-cf79-4325-9be9-e1aeee48c269]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:09 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 Sep 02 13:06:09 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:09 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:09 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 Sep 02 13:06:09 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:09 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:09 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5 Sep 02 13:06:09 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:10 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751.19c1f760-7c90-461b-87d7-1bdbb77528d5" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-19c1f760-7c90-461b-87d7-1bdbb77528d5" released by "_delete_snapshot" :: held 1.519s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" released by "delete_snapshot" :: held 1.541s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Created reservations ['188daafe-98f3-4159-b4c1-6317cd6b96ee', '9029034c-53ca-463f-b78b-7a2dbe11de85', 'fe8c79d7-0ade-4f34-aa79-43ed607c2552', 'ad48a6d0-6a46-4f07-92c8-1a0b5cfb6569'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbf22921-8deb-4ff8-b402-bd9d5fd8bc62 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-19c1f760-7c90-461b-87d7-1bdbb77528d5-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-b1458e82-d1f9-4d2c-b241-6e720e10b751-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "cinder-b1458e82-d1f9-4d2c-b241-6e720e10b751-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1836f77-cb38-468f-8d58-db123c73a7aa]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:10 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 Sep 02 13:06:11 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:11 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:11 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751 Sep 02 13:06:11 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:11 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-b1458e82-d1f9-4d2c-b241-6e720e10b751" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-b1458e82-d1f9-4d2c-b241-6e720e10b751" released by "delete_volume" :: held 0.680s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Created reservations ['dd244f5c-bd72-4f4b-90eb-968a1d1e7709', 'dddd51ca-9f2b-48e3-a5eb-21c2c12c8453', '974b9cbc-f7a2-42bc-9a58-0e00ada6c011', 'f63ab6f3-7db5-47a1-af51-29aa37ebdfa8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:11 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:11 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:11 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:06:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5d1e19a9-7639-4591-a1f3-b93234af930c tempest-ProjectMemberTests-1842815735 None] Lock "cinder-b1458e82-d1f9-4d2c-b241-6e720e10b751-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (48127845-0eae-449c-bba0-5a20f238331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba23aafc-7a2b-4767-a288-902b4895d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba23aafc-7a2b-4767-a288-902b4895d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244580396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b4f401-29b1-433a-9ac3-789619fe1e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:12Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d884280-5d7a-4e7e-b6be-555049092195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d884280-5d7a-4e7e-b6be-555049092195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3878317-0de6-44a1-b6f6-d36c7ff8c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3878317-0de6-44a1-b6f6-d36c7ff8c128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b4f401-29b1-433a-9ac3-789619fe1e92', 'volume_name': 'volume-87b4f401-29b1-433a-9ac3-789619fe1e92', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cddeb1a-ac40-496c-bacc-f008061afd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cddeb1a-ac40-496c-bacc-f008061afd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae04785-e697-4124-99ac-7cec059038ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Volume 87b4f401-29b1-433a-9ac3-789619fe1e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b4f401-29b1-433a-9ac3-789619fe1e92', 'volume_size': 1} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244580396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b4f401-29b1-433a-9ac3-789619fe1e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d8238b74f94f13871e7957b59eb793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:12Z,use_quota=True,user_id='a530f7fb1f5042e090f324835671255f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Creating volume 87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:06:12 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:12 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 1073741824 Sep 02 13:06:12 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:12 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 1073741824" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:12 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 Sep 02 13:06:12 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:13 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92" returned: 0 in 0.235s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae04785-e697-4124-99ac-7cec059038ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b4f401-29b1-433a-9ac3-789619fe1e92', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c476f061-24c0-4a55-bc2d-8d01950df394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Volume volume-87b4f401-29b1-433a-9ac3-789619fe1e92 (87b4f401-29b1-433a-9ac3-789619fe1e92): created successfully Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c476f061-24c0-4a55-bc2d-8d01950df394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Flow 'volume_create_manager' (48127845-0eae-449c-bba0-5a20f238331b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-862ddf86-606b-42bc-b63c-b498b90f06f7 tempest-ProjectMemberTests-1842815735 None] Created volume successfully. Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Creating offline snapshot 3045e0f8-567b-4a20-a3c7-33e38cd18c43 of volume 87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd33606-f4ab-49b4-8a34-561bbbd2f7d0]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:13 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 Sep 02 13:06:13 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:13 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:13 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 1G Sep 02 13:06:13 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:14 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 1G" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b4f401-29b1-433a-9ac3-789619fe1e92 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:14 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b4f401-29b1-433a-9ac3-789619fe1e92 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 Sep 02 13:06:14 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:14 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b4f401-29b1-433a-9ac3-789619fe1e92 -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 is being set with open permissions: ugo+rw Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:14 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 Sep 02 13:06:14 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:14 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:14 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info Sep 02 13:06:14 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:15 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info is being set with open permissions: ugo+rw Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:15 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info Sep 02 13:06:15 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:15 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.info" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d9fe3729-149a-49ff-a8b7-7817ec81b88d tempest-ProjectMemberTests-1842815735 None] Create snapshot completed successfully Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-3045e0f8-567b-4a20-a3c7-33e38cd18c43-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-3045e0f8-567b-4a20-a3c7-33e38cd18c43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-3045e0f8-567b-4a20-a3c7-33e38cd18c43" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-3045e0f8-567b-4a20-a3c7-33e38cd18c43" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Deleting offline snapshot 3045e0f8-567b-4a20-a3c7-33e38cd18c43 of volume 87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] snapshot_file for this snap is: volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce32d0e7-808b-4200-8915-aae5454da553]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:15 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 Sep 02 13:06:15 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:16 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b4f401-29b1-433a-9ac3-789619fe1e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb359245-6e86-4d9f-aa44-178d74324f46]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:16 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 Sep 02 13:06:16 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:16 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:16 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 Sep 02 13:06:16 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:16 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:16 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43 Sep 02 13:06:16 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:17 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92.3045e0f8-567b-4a20-a3c7-33e38cd18c43" returned: 0 in 0.231s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-3045e0f8-567b-4a20-a3c7-33e38cd18c43" released by "_delete_snapshot" :: held 1.346s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" released by "delete_snapshot" :: held 1.365s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Created reservations ['431d4404-77c6-4ab7-8d73-baa41d77377d', '75840194-1974-40ba-961f-022117c63dd4', '8a130dda-028b-412b-b512-f37749d5511f', 'aa1b433e-5a9a-4de4-91f8-52a74c2a8ec5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Delete snapshot completed successfully. Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b09375-3d68-4957-a27e-98728a8f1418 tempest-ProjectMemberTests-1842815735 None] Lock "cinder-3045e0f8-567b-4a20-a3c7-33e38cd18c43-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-87b4f401-29b1-433a-9ac3-789619fe1e92-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "cinder-87b4f401-29b1-433a-9ac3-789619fe1e92-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Acquiring lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2373121f-3682-41e6-a8c6-18cf6ddeeaa4]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:18 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 Sep 02 13:06:18 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:18 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:18 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92 Sep 02 13:06:18 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:18 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-87b4f401-29b1-433a-9ac3-789619fe1e92" returned: 0 in 0.236s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "cinder-quobyte-87b4f401-29b1-433a-9ac3-789619fe1e92" released by "delete_volume" :: held 0.639s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Created reservations ['f978bc6b-31fc-442f-b5f7-710d31ad7563', '66a6b168-5cb2-4231-9361-0e7c50f006f0', '59558fd8-24fd-4330-bf08-73daf1578c02', 'f662daf6-085e-4b38-ba38-45f5219e698e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:18 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:18 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:18 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.234s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Deleted volume successfully. Sep 02 13:06:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dffdf99-554e-4524-a015-433270dff1ba tempest-ProjectMemberTests-1842815735 None] Lock "cinder-87b4f401-29b1-433a-9ac3-789619fe1e92-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=36,cinder:INSERT=16,cinder:UPDATE=49,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:06:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:DELETE=7,cinder:SELECT=41,cinder:INSERT=13,cinder:UPDATE=51 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:37 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:37 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:37 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.332s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread count: 29 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 13:06:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cbeb5a68-25d2-4bab-901f-ca04655bc1b9 None None] thread info: [<_MainThread(MainThread, started 138492924469376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Flow 'volume_create_manager' (312613dc-704b-4577-942e-bf6573b026ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f90679-a634-4aaa-98b7-240c5942e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f90679-a634-4aaa-98b7-240c5942e04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895462793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2104e2d4-2018-456d-b2f0-f6ef61be1e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e34354714d4c7c923a38dfde1a83f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:44Z,use_quota=True,user_id='cf588f9a40bc4073bd1f143d9efa08b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6461e302-0073-46b7-b3e1-6922181a418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6461e302-0073-46b7-b3e1-6922181a418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bdf56a-c753-49ca-b653-9d357fb8e3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bdf56a-c753-49ca-b653-9d357fb8e3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2104e2d4-2018-456d-b2f0-f6ef61be1e9b', 'volume_name': 'volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c56206-923e-4a66-a4ea-4b8b0c54956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c56206-923e-4a66-a4ea-4b8b0c54956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f8d8a2-9557-4e4c-8c48-4ce5b87bc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Volume 2104e2d4-2018-456d-b2f0-f6ef61be1e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b', 'volume_size': 1} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895462793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2104e2d4-2018-456d-b2f0-f6ef61be1e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e34354714d4c7c923a38dfde1a83f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:44Z,use_quota=True,user_id='cf588f9a40bc4073bd1f143d9efa08b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Creating volume 2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:06:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] casted to osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:44 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b 1073741824 Sep 02 13:06:44 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:44 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b 1073741824" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:44 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:44 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:45 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f8d8a2-9557-4e4c-8c48-4ce5b87bc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a923ed6f-6e09-4b47-ada0-7acfe3462f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Volume volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b (2104e2d4-2018-456d-b2f0-f6ef61be1e9b): created successfully Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a923ed6f-6e09-4b47-ada0-7acfe3462f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Flow 'volume_create_manager' (312613dc-704b-4577-942e-bf6573b026ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8186371f-670a-44fc-985e-92f68724c1dc tempest-SnapshotDependencyTests-1443847837 None] Created volume successfully. Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Creating offline snapshot 60a73be6-0f98-4a9d-b5f6-ac08446526e9 of volume 2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[486acda1-2a66-45f3-a2ac-d852d9e77ec1]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:45 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:45 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:45 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:45 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 1G Sep 02 13:06:45 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:46 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 1G" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:46 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:46 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:46 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b -F qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:46 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 is being set with open permissions: ugo+rw Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:46 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:46 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:46 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:46 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info Sep 02 13:06:46 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:47 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:47 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info is being set with open permissions: ugo+rw Sep 02 13:06:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:47 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info Sep 02 13:06:47 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:47 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.info" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4bc40b11-8eab-4b84-9360-fc6b56f066e8 tempest-SnapshotDependencyTests-1443847837 None] Create snapshot completed successfully Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Flow 'volume_create_manager' (0c208f08-a474-4d04-98ef-05f802562d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d305a-6a36-4d82-82e7-48d0e4db9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d305a-6a36-4d82-82e7-48d0e4db9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-02T11:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae94714-4492-41aa-a7ae-98c4a0865e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e34354714d4c7c923a38dfde1a83f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-02T11:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60a73be6-0f98-4a9d-b5f6-ac08446526e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-02T11:06:48Z,use_quota=True,user_id='cf588f9a40bc4073bd1f143d9efa08b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70e22da9-b314-44a5-87dd-f850ed77a338),volume_type_id=70e22da9-b314-44a5-87dd-f850ed77a338)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a08602-2050-44ba-9531-0cb6a85ec40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a08602-2050-44ba-9531-0cb6a85ec40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02808956-b8e6-4559-81d5-52ee4cdb91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02808956-b8e6-4559-81d5-52ee4cdb91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ae94714-4492-41aa-a7ae-98c4a0865e06', 'volume_name': 'volume-4ae94714-4492-41aa-a7ae-98c4a0865e06', 'volume_size': 1, 'snapshot_id': '60a73be6-0f98-4a9d-b5f6-ac08446526e9'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb3e5d5-582a-4fb7-8243-3c98b91ca032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb3e5d5-582a-4fb7-8243-3c98b91ca032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64b3a2-0834-49d3-a6c5-859f13c8ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Volume 4ae94714-4492-41aa-a7ae-98c4a0865e06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ae94714-4492-41aa-a7ae-98c4a0865e06', 'volume_size': 1, 'snapshot_id': '60a73be6-0f98-4a9d-b5f6-ac08446526e9'} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9-4ae94714-4492-41aa-a7ae-98c4a0865e06" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9-4ae94714-4492-41aa-a7ae-98c4a0865e06" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Creating volume 4ae94714-4492-41aa-a7ae-98c4a0865e06 from snapshot 60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Selected osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88 as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] snapshot: 60a73be6-0f98-4a9d-b5f6-ac08446526e9, volume: 4ae94714-4492-41aa-a7ae-98c4a0865e06, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[51174e93-7067-4abb-9b7c-4ad896d7f86a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:48 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:48 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:48 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f2c1d-2b8a-4426-aac8-2c26deba1402]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:48 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:48 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:49 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 13:06:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 13:06:49 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Path /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 13:06:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:49 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 Sep 02 13:06:49 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:53 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06" returned: 0 in 4.083s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Image conversion details: src /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 13:06:53 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Converted 1024.00 MB image at 250.70 MB/s Sep 02 13:06:53 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 is being set with open permissions: ugo+rw Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:53 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 Sep 02 13:06:53 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:53 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" released by "_copy_volume_from_snapshot" :: held 5.096s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9-4ae94714-4492-41aa-a7ae-98c4a0865e06" released by "_create_volume_from_snapshot" :: held 5.155s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.169s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb64b3a2-0834-49d3-a6c5-859f13c8ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae94714-4492-41aa-a7ae-98c4a0865e06', 'volume_size': 1, 'snapshot_id': '60a73be6-0f98-4a9d-b5f6-ac08446526e9'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a8aa4-1472-42db-8d47-4b91560163a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 13:06:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Volume volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 (4ae94714-4492-41aa-a7ae-98c4a0865e06): created successfully Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a8aa4-1472-42db-8d47-4b91560163a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Flow 'volume_create_manager' (0c208f08-a474-4d04-98ef-05f802562d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 13:06:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cd52d9bd-9c75-4554-b923-78478a172eac tempest-SnapshotDependencyTests-1443847837 None] Created volume successfully. Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-60a73be6-0f98-4a9d-b5f6-ac08446526e9-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-60a73be6-0f98-4a9d-b5f6-ac08446526e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Deleting offline snapshot 60a73be6-0f98-4a9d-b5f6-ac08446526e9 of volume 2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] snapshot_file for this snap is: volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faba57c-72fc-41e7-8d9c-b0fab17c6dc2]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:53 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:53 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:54 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9c5674-84ea-46ab-8161-00c9abdf2988]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:54 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:54 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:54 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.524s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:54 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:54 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:54 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:54 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9 Sep 02 13:06:54 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:55 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b.60a73be6-0f98-4a9d-b5f6-ac08446526e9" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-60a73be6-0f98-4a9d-b5f6-ac08446526e9" released by "_delete_snapshot" :: held 1.540s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" released by "delete_snapshot" :: held 1.562s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Created reservations ['abe663eb-fa8d-48e9-bbb5-2a9bc524f185', 'a58a9bf5-34cc-4ae0-854d-57a27396f19d', '206f1dcf-9b10-499f-b6d5-7d9d04f257a5', 'a183d2ff-99b3-4e60-a2bb-b7f7ec322ddf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Delete snapshot completed successfully. Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-729d7599-a484-4063-ae4e-533d491d9d2c tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-60a73be6-0f98-4a9d-b5f6-ac08446526e9-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-2104e2d4-2018-456d-b2f0-f6ef61be1e9b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-2104e2d4-2018-456d-b2f0-f6ef61be1e9b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab52164-0492-4f9c-9254-b6dbf325ab4b]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:56 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:56 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:56 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:56 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b Sep 02 13:06:56 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:56 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-2104e2d4-2018-456d-b2f0-f6ef61be1e9b" released by "delete_volume" :: held 0.672s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Created reservations ['2043cbe7-c798-46be-adb6-b3fae5521a2f', 'd27af1ad-8407-4ece-b991-ca085586938e', 'd6dfe5de-9a70-4b52-8aaa-9d93f3ef09fa', 'c2435f69-233e-4f1f-824d-948841047a8a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:56 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:56 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:56 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Deleted volume successfully. Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b57fea7-e869-4deb-82f8-99aad2dae6c8 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-2104e2d4-2018-456d-b2f0-f6ef61be1e9b-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-4ae94714-4492-41aa-a7ae-98c4a0865e06-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-4ae94714-4492-41aa-a7ae-98c4a0865e06-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f436d1-5808-4ab2-9085-ff69b2c40c7a]: (4, 'qcow2') {{(pid=88815) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:57 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 Sep 02 13:06:57 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:57 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:57 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06 Sep 02 13:06:57 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:57 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9/volume-4ae94714-4492-41aa-a7ae-98c4a0865e06" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-quobyte-4ae94714-4492-41aa-a7ae-98c4a0865e06" released by "delete_volume" :: held 0.623s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Created reservations ['d8990cb3-ee71-4161-b28f-2c8ff99f20bb', 'f7b74e0b-60a1-48f6-8cfb-4f8eadf00f94', '907f95c4-548e-4194-ad82-8244ebe78816', 'e880cd24-c564-403c-9706-886199b28b0d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e0c600dd-5c84-4ba4-a982-bbb08a659b88'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 13:06:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 13:06:57 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9 Sep 02 13:06:57 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 13:06:58 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 02 13:06:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c640d2c4f84f586a97a1a58d6f00f4b9" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 13:06:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 13:06:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Deleted volume successfully. Sep 02 13:06:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e0c044e8-683d-4908-8d44-37b916ee6c94 tempest-SnapshotDependencyTests-1443847837 None] Lock "cinder-4ae94714-4492-41aa-a7ae-98c4a0865e06-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 13:07:07 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:INSERT=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 13:07:08 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}